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10 BACKGROUND OF THE INVENTION 

S3 Field of the Invention 

The present invention relates generally to relational databases for storing and retrieving 
biological information. More particularly the invention relates to systems and methods for 
providing gene expression, gene annotation, and sample information in a relational format 



Jit 



Uks supporting efficient exploration and analysis. 
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Description of the Related Art 

DNA microarrays are glass microslides or nylon membranes containing DNA samples 
(e.g., genomic DNA, cDNA, or oligonucleotides) in an ordered two-dimensional matrix. DNA 
20 microarrays can be used to analyze gene expression and genomic clones or to detect single 
nucleotide polymorphisms ("SNP's"). The DNA used to create a microarray is often from a 
group of related genes such as those expressed in a particular tissue, during a certain 
developmental stage, in certain pathways, or after treatment with drugs or other agents. 
Expression of that group of genes is quantified by measuring the hybridization of fluorescently 



labeled RNA or DNA to the microarray-linked DNA sequences. By profiling gene expression, 
transcriptional changes can be monitored through organ and tissue development, microbiological 
infection, and tumor formation. 

Also known as biochips, DNA microarrays can be created by linking monomeric 
nucleotides on the glass surface to make oligonucleotides. Another methodology, popular for 
making arrays of polymerase chain reaction (PCR) products and organismal genes, uses robotic 
instruments to spot thousands of DNA samples onto a surface. This high-throughput approach 
increases reproducibility and production. 

Making the arrays entails transferring 1-2 nl of DNA sample from 96-1500 well 
microplates to a 100-200 ^m spot on the glass microslide. This is accomplished through single 
spotting with solid pins or multiple spotting with "split" pins. Output is determined by the 
number of pins, input microplates, and output microslides. Microarray readers, such as surface 
fluorometers, are also part of this equation. Since microarrays are used in university research, 
small and large biopharmaceutical companies, and large-scale clinical trial investigations, there 
are a variety of instruments and integrated systems to meet these diverse needs. 

Affymetrix of Santa Clara, California, provides high-volume production methods that can 
support the diagnostics or drug development industries. Affymetrix offers GeneChip technology, 
which uses glass microarrays manufactured by a proprietary process that combines solid-phase 
chemistry and photolithography to build probes in situ . The glass wafers are packaged in plastic 
cartridges in which hybridization is carried out. Several hardware components form the 
GeneChip suite. The GeneChip Fluidics Station 400 introduces the sample into the probe array 
cartridge. The Hybridization Oven 640 processes up to 64 cartridges. Agilent Technologies 
designed its GeneArray scanner (monochrome; 20 ^m resolution) to be used exclusively with 



Affymetrix microarrays, and the scanner is distributed by Affymetrix for integration into the 
GeneChip suite. Affymetrix also offers a series of software solutions for data collection, 
conversion to AADIVF^ ("Affymetrix Analysis Data Model") database format, data mining, and 
a multi-user laboratory information management system ("LIIMS") system for power-hungry 
environments. 

With today's DNA microarray technology one can easily collect large amounts of data to 
indicate what genes or SNP's are turned on or turned off during various disease states, following 
various pharmacological treatments, or following exposure to a variety of toxicological insults. 
However, while the quantity of data that one can gather with these techniques is very large, it is 
often out of context. The relevance of genetic data is often determined by its relationship to other 
pieces of information. For example, knowing that there is an increased expression of a particular 
gene during the course of a disease is important information. In addition, there is a need to 
correlate this data with various types of clinical data, for example, a patient's age, sex, weight, 
stage of clinical development, stage of disease progression etc. What is needed in the field is a 
way to correlate the vast amounts of gene and SNP expression data that one can obtain with a 
DNA microarray with the corresponding clinical data fi-om the samples that are tested. 

The present invention satisfies the above described needs by providing methods and 
systems that correlate normal and diseased tissues or cell lines fi*om humans and experimental 
animals with critical clinical findings allowing target selection and prioritization with the 
possibility of studying the mechanisms of a particular disease. In addition, the present invention 
provides a system and method that utilizes the ability to examine the affects of therapeutic 
compounds on human and animal tissues or cell lines. One can easily study the mechanism of 
action of therapeutic compounds and the characteristics of experimental model systems by 



comparing the gene expression data with known therapeutic and experimental parameters. 
Similarly, the present invention provides a system that allows one to examine the affects of toxic 
compounds on tissues and cells in both a pre-clinical and clinical setting. 



5 BRIEF SUMMARY OF THE INVENTION 

It is an object of the present invention to provide a system and method for correlating the 

vast amounts of gene and SNP expression data that one can obtain with a DNA microarray with 

the corresponding clinical data from the samples that are tested. 

It is another object of the present invention to provide a system and method that utilizes 

D 

gjO the ability to examine the affects of therapeutic compounds on human and animal tissues or cell 

y3 

23 lines. 

It is another object of the present invention to provide a method and system that 
^ J correlates normal and diseased tissues or cell lines from humans and experimental animals with 

y critical clinical findings allowing target selection and prioritization with the possibility of 

IJI 

g J 5 studying the mechanisms of a particular disease. 

h 

BRIEF DESCRIPTIQN OF THE DRAWINGS 
Figure 1 is an illustration of a data warehouse star relational schema in accordance with 
an embodiment of the present invention. 

Figure 2 is a block diagram of a suitable computing architecture for providing database 
20 services in accordance with one embodiment of the present invention; 

Figure 3 is a block diagram of a data warehouse in accordance with an embodiment of the 
present invention; 

Figure 4 is an illustration of possible sample attributes included in the sample space in 
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accordance with one embodiment of the present invention; 

Figure 5 is an illustration of a snowflake schema for modeling the sample space in 
accordance with one embodiment of the present invention; 

Figure 6 is an illustration of a snowflake schema for modeling the gene annotation space 
5 in accordance with one embodiment of the present invention; 

Figure 7 is an illustration of a snowflake schema for modehng the gene expression space 
in accordance with one embodiment of the present invention; 

Figure 8 is an illustration of an integrity constraint enforcement mechanism according to 
the present invention; 

00 Figure 9 is an illustration of an accessioning process according to the present invention; 

h 

□ Figure 10 is an illustration of a process flow according to the present invention; 

M 

Figure 1 1 is an illustration of a contrast analysis; 
J, J Figure 12 is an illustration of a contrast analysis;and 

|ij Figure 13 is an illustration of a contrast analysis. 

ill 
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DETAILED DESCRIPTION OF THE INVENTION 
Microarray technologies enable the generation of vast amounts of gene expression data. 
Effective use of these technologies requires mechanisms to manage and explore large volumes of 
primary and derived (analyzed) gene expression data. Furthermore, the value of examining the 
20 biological meaning of the information is enhanced when set in the context of sample profiles and 
gene annotation data. The format and interpretation of the data depend strongly on the 
underlying technology. Hence, exploring gene expression data requires mechanisms for 
integrating gene expression data across multiple platforms and with sample and gene 
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annotations. The present invention uses data warehousing methodology to manage and explore 
gene expression and related data. 

Generally, the present invention provides a system comprising a data warehouse for 
storing large amounts of data and having a structure that supports efficient gene expression 
5 exploration and analysis. The data warehouse may contain quantitative gene expression 

information on normal and diseased tissues, experimental animal model and cellular tissues, as 
well as a variety of treated and untreated conditions. The data warehouse may also contain 
comprehensive information on samples, clinical profiles, and rich gene annotations. 

In an embodiment of the present invention, the data warehouse may be modeled as 

□ 

Oo separate sample, gene annotation, and gene expression multi-dimensional data spaces. Basic 
£3 operations in these data spaces in terms of traditional on-line analytical processing ("OLAP") 
dimension reduction and aggregation manipulations may be used for complex gene expression 
Q analysis operations.. Data warehouse management tools are used for maintaining data 
g j consistency, with process specific consistency rules checking the correct execution of data 

yi 

£3 5 migration and integration processes and with domain specific rules validating sample, 

lU 

expression, and gene annotation data. In accordance with one embodiment of the present 
invention, an archive may be used to provide a uniform analysis interface for gene expression 
data &om alternate gene expression databases, such as the Genbank public domain database 
available on the Internet at www.ncbi.nlm.nih.gov/Genbank. 
20 Having briefly described an embodiment of the present invention, basic data warehouse 

concepts are set forth in order to provide a more thorough understanding of the present invention. 
The reader should appreciate, however, that the present invention may be practiced without 
limitation to the specific details presented herein. 
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Basic Data Warehouse Concepts 

A data management infrastructure for gene expression data must satisfy two major goals: 
data acquisition and data analysis. The database technologies needed to address these goals are 
substantially different. Data acquisition has been a traditional application for operational 
5 databases, which are characterized by rapid content substitution as well as the need to support 
rapid data updates in real time. Generally, operational databases are designed to optimize update 
performance. In contrast to operational databases, data warehouses are characterized by periodic, 
rather than real time, content accumulation as well as the need to support rapid exploration of 
massive amounts of data. Information in data warehouses come from diverse, usually 
gjo heterogeneous, sources and therefore requires information integration. Generally, data 

P warehouses are designed to optimize query performance for faster data access and for on-hne 

M 

analytical processing. 

4S 

'J^ At the core of a data warehouse is a primary measure attribute associated with a fact 

object, where the value for the measure attribute is analyzed using the warehouse directly or via 

gjs an OLAP mechanism. The fact object is modeled in the context of different dimension objects, 
where each dimension is characterized by one or more category attributes. Category attributes 
may, in turn, be organized in a specialization hierarchy. A typical example of a data warehouse 
application involves a product sold in stores on certain dates, where: quantity sold is the measure 
object, product, store, and date are the associated dimensions, product is characterized by 
20 category (e.g., cloth, electronic), store is characterized by location (e.g., city, state), and date is 
characterized by time (e.g., year, month, day). 

Data warehouses are usually structured using a star relational schema such as illustrated 
by the example shown in Figure 1, where each dimension is represented by a table, such as Gene 
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table 104. The fact table, Expression table 102, contains the main information about the measure 
object and its relationship to the dimension tables 104, 106, and 108. Snowflake schemas extend 
the star schema by providing auxiliary tables for representing more complex dimension 
structures. Snowflake schemas will be further described below with reference to Figure 3. 

OLAP applications view a data warehouse as a multidimensional data space where 
aggregation functions, such as summarization, can be applied on the measure values. Other 
OLAP operations include (I) a combination of selection and projection operations, also known as 
slice and dice operations, which combines a projection on the multidimensional space (slice) 
with a selection of ranges over the projected dimension (dice); (2) aggregation operations (e.g., 
summarization) of the measure in a given dimension over one level of the classification 
hierarchy associated with that dimension, also known as roll-up operations; and (3) 
disaggregation operations, also known as drill-down operations, which are the reverse of the 
aggregation operations. For example, a projection operation (slice) can be applied in order to 
look at the data in a two dimensional space (e.g., location and date); a selection operation (dice) 
can be used to look at products sold on certain days; and an aggregation operation can be used to 
summarize quantity sold for a given product category (e.g., electronics). 

Unlike traditional data warehouse applications that deal with data representing relatively 
simple, and precise real-world facts, such as product sales, scientific data in general, and gene 
expression data in particular, represent complex and often imprecise phenomena. For example, 
the data may change over time as a reflection of the evolution of the underlying scientific 
methods used to generate data, and often represent interpretations of experimental results using 
complex analytical methods. 

Accordingly, the complexity of gene expression data entails modeling the data partitioned 
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into three databases: sample, fragment index, and gene expression. Those skilled in the art 
should appreciate that these databases may require updating, or refreshes, as the underlying 
scientific methods evolves. 

System For Gene Expression Exploration And Analysis 

Referring now to the drawings, in which like numerals represent like elements throughout 
the several figures, aspects of the present invention will be described. Figure 2 and the following 
discussion are intended to provide a general description of a suitable computing architecture in 
which the invention may be implemented. 

Referring to Figure 2, a gene expression data management infrastructure is shown 



g|o comprising a Data Management System ("DMS") 210 and a Data Warehouse ("DW") 220. Li 

Q accordance with an embodiment of the present mvention, DMS 210 comprises operational 

t{2 databases and laboratory information management system ("LIMS") applications that support 

□ 



data acquisition and management of production data. 

In accordance with an embodiment of the present invention, DW 220 comprises 



^5 summarized and curated gene expression data, integrated with sample and gene annotation data, 
and provides support for effective data exploration and mining. As previously described, D W 
220 may be partitioned into three databases: Sample database 222, Fragment Index database 224, 
and Gene Expression database 226. 

In accordance with an embodiment of the present invention, gene expression data may be 

20 generated using the Affymetrix GeneChip platform, marketed by Affymetrix Corporation of 
Santa Clara, California, and may be represented in the Affymetrix Analysis Data Model 
("AADM") relational format extended with specific fields. In the AADM representation, the 
method dimension for the gene expression data space involves two analysis methods: cell 
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averaging and chip analysis. In one embodiment of the present invention, the results of cell 
averaging and chip analysis may be stored in two fact tables, the 
MEASUREMENT_ELEM_RESULT ("MER") and the ABS_GENE_EXPR_RESULT 
("AGER") tables, respectively. Because of the considerable amount of data contained in DW 
5 220, the management of both tables may be problematic. For example, one human sample can 
involve five experiments that result in 1 .25 million rows in the MER table and 42,000 rows in 
the AGER table. Accordingly, in accordance with an embodiment of the present invention, the 
AGER table may be explored using an OLAP-like multi-dimensional array. Additionally, the 
MER table may be partitioned and archived. The reader should appreciate that experimental 

□ 

gJO parameters such as protocol version, analysis software build, and analysis method may also be 

h 

□ stored in DW 220. 

«i« Still referring to Figure 2, an Archive 230 is provided for storing raw data files generated 

\, by microarray experiments. In addition, Archive 230 provides tertiary storage for the probe-pair 
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data ofthe MER table. 

In one embodiment of the present invention, the Archive 230 may be organized as a 
multi-layered storage system. The first layer involves a relational database and a network file 
system, where the database maintains indices for fast content-based retrieval for the probe pair 
data, while the network file system stores the probe pair data and image data, such as the GEL 
and the DAT files, for the samples in DW 220. The second layer is based on a near-line optico- 
20 magnetic storage system that stores all data files as well as all the ancillary files generated by 
DMS 210, such as process tracking data, and intermediate data files. Generation of data files will 
be further described below with reference to the detailed description of DMS 210. The third layer 
of Archive 230 is a second off-line back up storage system that provides enhanced recoverability 
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and fault tolerance. 

In accordance with an embodiment of the present invention, the Sample, Fragment Index, 
and Gene Expression databases 222, 224, and 226 of DW 220 can be explored collectively or 
independently using an Explorer 240, which provides support for constructing gene and sample 
sets, for analyzing gene expression data in the context of gene and sample sets, and for managing 
individual or group analysis workspaces, such as User Workspace 250. 

As shown in Figure 2, a Run Time Data Representation 260 may also be provided to 
implement a multi-dimensional gene expression matrix ("GXM") and rapidly access the core 
data stored in the DW 220, The multi-dimensional GXM may be used for exploring gene 
expression data and provides a data representation that is independent of the underlying gene 
expression technology platform. In one embodiment of the present invention, the data may 
include: absent/present calls for each sample/probe pair, intensities, and chips available for each 
sample. The run time data representation is part of the Run Time Engine, a system component 
that is intended to provide high performance gene expression analysis. In one embodiment of the 
present invention, programming access to Run Time Engine 260 may be through low-level C++ 
APIs to reflect the underlying implementation and memory model. In addition, high-level C++ 
APIs may be used to provide support for various high level concepts, such as gene sets and 
sample sets, which will be further described below. Moreover, an IDL interface based on high- 
level C++ APIs may be provided to support additional classes and methods necessary for 
performing high-level analysis functions. 

The analysis methods supported by the Explorer 240 and the Run Time Engine 260, 
provide an efficient mechanism to manipulate gene expression data. The middle layer of the 
computing architecture of Figure 2 supports a range of APIs for integrating additional analysis 



11 



tools. The list of the APIs includes a call-level interface to the gene expression archive (GXA), a 
query translator (middleware for database queries), and the Workspace API for user 
management 235, 237, and 255. 

In accordance with an embodiment of the present invention, Explorer 240 supports a 
5 variety of analysis methods and tools. For example, one of the basic gene expression analysis 
operations provided by the present invention is the Gene Signature tool. The Gene Signature tool 
identifies consistently present and absent genes from a gene set, G, over a sample set, S. The 
result of a Gene Signature on G and S consists of the pair {CPG (G, S), CAG (G, S)}, where 
|„6 CPG denotes consistently present genes and CAG denotes consistently absent genes. A 

□o threshold, such as (card (5) - k), where card (S) denotes the cardinality of set S and k is 1,2, n, 

ifl 

0 is often used in computing Gene Signatures. A Gene Signature Differential analysis tool 
'^^ compares the results of two Gene Signature analyses and computes four new sets of fragments: 
those that are in both the first present gene set and the second absent gene set; those are in both 
the first absent gene set and second present gene set; those that are in both present gene sets; and 
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1!J5 those that are in both absent gene sets. 

h 

The accuracy of the Gene Signature depends on the size of the sample set, where a larger 
sample set ensures that genes that vary in expression between individuals are excluded. A Gene 
Signature over sample set S is considered accurate if adding any new sample to S reduces CPG 
(G, S) u CAG (G, S) by no more than 2.5%. 
20 Where CPG denotes consistently present genes, CAG denotes consistently absent genes, 

IPG denotes inconsistently present genes, and lAG denotes inconsistently absent genes. Let G be 
all the gene fragments monitored in DW and S a sample set. Present/ Absence calls orders genes 
in G in four groups CPG, IPG, JAG, CAG. Gene Signatures analysis may be generalized to 



12 



multiple sample sets, Si, Sn, as follows: Differentially expressed genes in set Si versus sets 
S2, Sn, defined by the pair: 

{(CPG (G, Si) n CAG (G, S2) fl... fl CAG (G, Sn)) 
(CAG (G, SI) n CPG (G, S2) H ... 0 CPG (G, Sn))}. 
5 Unique consistently expressed genes in set SI versus sets S2, Sn, defined by the pair: 

{(CPG (G, Si) n IPG (G, S2) 0 ... 0 IPG (G, Sn)), 
(CAG (G, SI) n lAG (G, S2) fl ... 0 lAG (G, Sn))}. 
Common consistently expressed genes in SI, Sn, defined by the pair: 
{(CPG (G, Si) n ... n CPG (G, Sn)), 
ho (CAG (G, Si) n ... n CAG (G, Sn))} . 

f 

tt3 Common inconsistently expressed genes in SI, Sn, defined by the pair: 

f {(IPG (G, SI) n ... n IPG (G, Sn)), 

P (lAG (G, Si) n ... n IAG (G, Sn))}. 

ifj Additional gene expression analysis operations supported by Explorer 240 include fold 

rj5 change analysis and sample set analysis. Fold change analysis computes for each gene fi-agment 
in a get set G, the ratios of the mean log expression values between a sample set S and a control 
sample set; the first step of this analysis involves gene expression averaging on the sample 
dimension. Sample set analysis computes the range of expression levels for each gene in a gene 
set, G, across a sample set, S, in which the gene is consistently expressed. The first step of this 
20 analysis involves identifying the samples of a sample set in which all the genes from a gene set 
are consistently (present or absent) expressed genes. 

Gene and sample query supports the definition of sample set and gene sets. Gene 
sequence query allows a user to determine if a gene sequence matches any of the genes or EST's 
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in the Fragment Index Database 224. 

Clustering allows to identify groups of similar genes or similar samples based on their 
expression profiles. This well-known technique is useful for learning the structure of a dataset 
without making any preconceived assumption. 
5 Electronic northern tool analysis determines the ranges of expression values of genes and 

EST's across all tissue types represented in the DW 222. More particularly, a user-defined gene 
set and one or more samples sets are used to report the range of expression levels for each gene 
fragment in the gene set across each sample set, for all the samples where the fragment is called 
present. The range is reported using upper and lower percentile levels specified by the user. For 
qilO example, if the user chooses 100% and 0% as the upper and lower percentile levels, the analysis 
□ reports the maximum and minimum range of expression levels for all present calls. 
'I; Results of gene expression exploration can be further examined in the context of gene 

annotations, such as pathway and chromosome maps, where gene expression data are represented 
p in the fi*amework of specific (e.g., metabolic) pathway or chromosome cytogenetic maps. A 
13 5 pathway visualization uses a graph representing the components of a metabolic or signaling 
pathway, highlighted with colored bands to denote the expression levels of the genes or gene 
products involved in the pathway. The bands may be divided horizontally into separate 
rectangles, each corresponding to an expression level for a particular sample. Alternatively, the 
pathway visualization may be used in conjunction with a fold change analysis, with the band 
20 colors corresponding to fold change values. 

hi a metabolic pathway, the components represent enzymatic activities that may be 
identified by EC numbers. Strongly and weakly expressed genes encoding enzymes are darkly 
and lightly shaded, respectively. Multiple genes may code for enzymes with the same activity, 
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such as the many different alcohol dehydrogenases. In addition, multiple fragments may 
represent the same gene. The underlying pathway diagrams may be obtained from a public 
source, such as KEGG available at www.genome.ed.jp/kegg. Pathway visualizations may be 
performed for a particular sample set and gene set. The gene set may be computed indirectly 
from sample sets using the Gene Signature tool, Gene Signature Differential or Fold Change 
Analysis tools, or may be selected directly. 

The results of gene data exploration can also be examined visually using third-party tools, 
such as Spotfire, marketed by Spotfire Corporation of Cambridge, Massachusetts, or exported for 
analysis with statistical tools such as S-plus, marketed by Mathsofl Corporation of Seattle, 
Washington, GeneSpring from Silicon Genetics of San Carlos, CA, Partek, etc. 

Those skilled in the art should appreciate that the present invention may be implemented 
over a network environment. The network may be any one of a number of conventional network 
systems, including a local area network ("LAN"), a wide area network ("WAN"), or the Internet, 
as is known in the art (e.g., using Ethernet, IBM Token Ring, or the like). In addition, the present 
invention may also use data security systems, such as firewalls and/or encryption. 

Having briefly described a suitable computing architecture in accordance with 
embodiments of the present invention, a more detailed description of the components of the 
architecture is set forth. 
Data Warehouse 

Referring back to Figure 2, data warehouse (DW) 220 is provided to maintain very large 
amounts of data and has a structure that supports efficient gene expression exploration and 
analysis. In one embodiment of the present invention, DW 220 is the integrated product of three 
component databases that materialize the sample, gene annotation, and gene expression data 
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spaces discussed in the previous section. DW 220 is loaded with sample, gene annotation, and 
expression data from a staging area where the data is integrated after passing data consistency 
and quality validation. The staging area may also have a transient database (not shown) that 
provides a buffer between the data sources of DW 220 and DW 220 while data undergo various 
transformations. 

Referring now to Figure 3, Data Warehouse 220 in accordance with an embodiment of 
the present invention is shown. Sample database 222 forms an independent data space for 
analytical processing. The fact object in the sample data space 222 is a bio-sample representing 
the biological material that is screened in a microarray experiment, 

A bio~sample has a type and a species. The type of a bio-sample can be tissue, cell line, 
processed RNA, etc., and originates from a species-specific (e.g., human, animal) donor. In one 
embodiment of the present invention, a human bio-sample is associated to one or more QC types 
of QC records completed by expert review* The pathology QC review documents the correct 
pathological processes represented on a given tissue. The image QC review documents any 
defects found on scanned image of a microarray chip. QC reviews are performed on every single 
fragment of a tissue sample. 

A bio-sample may yield more than one genomic samples. A genomic sample is the entity 
screened in the production laboratory. A genomic sample might be based on 
more than one fragment from a given sample so as to provide sufficient quantity to yield 
adequate RNA. Those skilled in the art should appreciate that in certain instances, such as 
samples from mouse organs, several bio-samples may be required to generate a genomic sample. 
If the bio-sample is of type RNA or IVT, then there is a one-to-one correspondence between the 
bio-sample and genomic sample. 
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Referring now to Figure 4, illustrative sample attributes are shown. In accordance with an 
embodiment of the present invention, samples may be associated with attributes that describe 
properties useful for gene expression analysis, such as sample structural and morphological 
characteristics (e.g., organ site, diagnosis, disease, stage of disease, etc.), donor data (e.g., 
demographic and clinical record for human donors, or strain, genetic modification, and treatment 
information for animal donors). Samples may also be involved in studies and therefore can be 
grouped into several time/treatment groups. More particularly, samples are related to other 
samples in ways that depend on the collection process and their respective studies. For example, 
some known forms of collection process sample relatedness include: explicitly matched 
samples — a tumor liver sample and a normal liver sample from the same excision; implicitly 
related samples — samples from the same donor without any connection to a common condition; 
sample series — ordered set of samples such as samples from early, middle, and late stages of 
disease progression; and time series — samples from a group of similar donors after being treated 
with a compound for 1, 6, and 24 hours respectively. 

In addition, samples may be related to other samples through studies. One type of study 
provided by the present invention is a toxicology study, which is concemed with dose-response 
of samples/subjects overtime. Subjects, such as humans or rodents, are typically divided into 
multiple dose groups and observed at multiple time points. In rodent studies, bio-samples may be 
taken at sacrifice time as well as additional time points. Accordingly, a study may consist of 
many bio-samples grouped in groups of specific time and dose. A group may be seen either as a 
group of donors or a group of bio-samples. 

Referring back to Figure 4, samples may be obtained from a variety of sources, with 
sample information structured and encoded in heterogeneous formats. Format differences range 
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from the type of data being captured to different controlled vocabularies used in order to 
represent anatomy, diagnoses, and medication. In order to provide support for capturing samples 
from different sources, the sample data space is modeled as an independent data warehouse, with 
a star or snowflake schema structure, depending on the complexity of the sample data space. 
5 Figure 4 illustrates a snowflake schema for modeling the sample space. The sample category 
attributes can be organized in classification hierarchies implemented using controlled 
vocabularies or existing taxonomies such as the Systematized Nomenclature of Medicine 
("SNOMED") topography and morphology axes, for sample organ and diagnosis, respectively. 
OLAP-like operations can be used for navigating the sample space along various 

Z%0 taxonomies. For example, referring to Figure 5, analyzing a Biological Sample 502 for a specific 

f 

i3 diagnosis may involve a selection of the diagnosis and projection of a Pathology dimension 504. 
Further, in one embodiment of the present invention, where a classification of Donor data 506 
uses an Organ to Tissue hierarchy, summarization of samples on tissue type would result in the 
f J total number of samples classified by tissue type; moreover, summarization on organ type would 
5) 5 result in the total number of samples classified by organ type (e.g., liver, brain). 

rj 

In accordance with one embodiment of the present invention, samples may be classified 
either as public or private samples. In other words, samples may be classified in terms of 
ownership of samples and their subsequently derived gene expression data. Ownership may be 
used for restricting access to the data generated by a sample. For example, samples may include 
20 alliance, project, and visibility attributes that define access to the information. For example, data 
from a sample may be visible by all or specific to the alliance that requested the information. 

Now, referring back to Figure 3, gene fragment data, like sample data, may be considered 
as a separate data space shown as Fragment Index database 224. The fact object in the Fragment 
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Index database 224 is the gene fragment, representing the entity that is examined using a 
microarray. For example, for Affymetrix chips, the gene fragment represents the DNA sequence 
employed for synthesizing the oligonucleotide probes that are placed on the chips. Gene 
fragments are organized across two main dimensions: microarray design and biological 
annotation. 

The microarray design describes the physical characteristics of a chip type design, 
including the placement of sequence fragments on the array. This information is provided by the 
microarray manufacturer and is used to interpret the signal in a microarray experiment. The 
biological annotation for a gene fragment comprises determining its biological context, including 
its associated primary sequence entry in public sequence databases such as Genbank, 
membership in a Unigene sequence cluster, association with a known gene in LocusLink, and 
functional and pathway characterization. 

As those skilled in the art should appreciate, GenBank is the National Institutes of Health 
("NIH") genetic sequence database, an annotated collection of all publicly available DNA 
sequences that is available on the Internet at www.ncbi.nlm.nih.gov/Genbank. In addition, 
UniGene is a system for automatically partitioning GenBank sequences into a non-redundant set 
of gene-oriented clusters and is available at www.ncbi.nhn.nih.govfUniGene/, Finally, 
LocusLink provides a single query interface to curated sequence and descriptive information 
about genetic loci and is available at www.locuslinkxom. LocusLink presents information on 
official nomenclature, aliases, sequence accessions, phenotypes, EC numbers, MM numbers, 
UniGene clusters, homology, map locations, and related web sites. 

Referring back to Figure 3, gene fragment annotation involves integrating information 
from a variety of genomic data sources. Accordingly, the Fragment Index database 224 may also 
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be modeled as an independent data warehouse, with a star or snowflake schema structure, as 
illustrated by the example shown in Figure 6. 

An important aspect of the Fragment Index database 224 is the evolution of the science 
underlying recorded gene annotations. For example, the association of a gene fragment to a 
5 known gene may change because of the evolution of Unigene clusters or amendments to the 
known gene entries recorded in LocusLink. The evolution of gene data may affect the result of 
gene expression data analysis, and therefore must be tracked. The reader should appreciate, 
however, that gene data changes are different from historical data changes in traditional data 
warehouses in that historical data changes typically record changes of known indisputable facts 
^fO (e.g., prices of products) while the evolving gene data changes record changes in what is known 

h 

□ about scientific facts. Accordingly, gene annotation and gene sequence data 302 and 304 must 

"I- not only be extracted, validated, and integrated into DW 220, but also refreshed to reflect the 

'L evolution of science. 



associated with metabolic pathways may involve a selection of metabolic pathways and a 
projection on the pathway dimension. More particularly, in a classification of gene annotation 
data using the following hierarchy: Species to Chromosome to Known Gene, summarization of 
the gene fragments on known genes would resuh in the total number of fragments classified by 
20 their association with a known gene; further summarization on chromosome would result in the 
total number of gene fragments classified by chromosome. 

Referring back to Figure 3, gene expression data, like gene annotation and sample data, 
may also be considered as a separate data space shown as Gene Expression database 226. Gene 



S3 
W 
S3 



OLAP-like operations can be used for navigating the Fragment Lidex database 224 
mainly along the biological annotation dimension. For example, examming gene fragments 
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expression data may comprise data generated using READS technology, marketed by Gene 
Logic Corporation of Gaithersburg, Maryland, and QPCR technology, marketed by Lark 
Technologies Corporation of Houston, Texas. Those skilled in the art should appreciate that gene 
expression data originating from different platforms may be managed and structured 
5 independently, rather than using a common data format. Gene expression data generated using 
different platforms may be correlated via common samples (i.e. samples that are run using 
different technologies) or common genes. 

The multi-dimensional GXA used for exploring gene expression data provides a data 
representation that is independent of the underiying gene expression technology platform. Thus, 

□ 

i%Q the GXA can be used for uniformly exploring gene expression data generated using diverse 

□ platforms, such as the GeneChip, READS, QPCR, and cDNA Microarray platforms 

"^l 310,312,314, and 316. The GXA provides the framework for implementing the gene expression 
^« 

Q operations described above, and for integrating advanced data mining algorithms. 

y . , ^ 

j-j The fact object in the gene expression data space 226 is the gene expression value. Gene 

U1 

□5 expression data may be defined at several granularity levels. The data generated by measurement 
instruments, such as scanners, are at the highest level of granularity. Analysis programs turn the 
data into quantitative gene expression measurements. For example, the Affymetrix GeneChip 
involves (a) a cell averaging step that averages pixel intensities and computes cell-level 
intensities, where each cell corresponds to one probe on the microarray, followed by (b) a chip 
20 analysis step that generates gene expression values by "summarizing" the intensities of 

approximately 20 probe pairs that correspond to each gene or EST fragment on the microarray. 
The GeneChip expression value consists of a presence/absence ("PA") call and an absolute gene 
expression measurement. Alternate platforms, such as QPCR, reports an expression value per 
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gene and per sample, relative to a reference sample. The present invention provides a multi- 
dimensional structure that supports representing gene expression values generated with different 
platforms or analysis methods. 

The four primary dimensions in the gene expression data space are gene, sample, method 
5 and experiment, where gene and sample provide the connection to the gene annotation and 

sample data spaces 224 and 222, respectively. The gene expression data space 226 is modeled as 
an independent data warehouse, with a star or snowflake schema structure, as illustrated by the 
example shown in Figure 7. 

^ In one embodiment of the present invention, the experiment dimension links gene 

P 

r^O expression data to parameters such as the chip lot, experimental protocol, and software version. 

33 

□ These parameters refer to the data generation process. 

The method dimension models the different gene expression values generated usmg 

^: 

L different analysis methods, such as GeneChip PA values and GeneChip generated absolute gene 

O 

ja^ expression values. Gene expression values can be classified into present, absent, marginal, or 

ill 

gj5 unknown calls. 

ru 

Variants of OLAP operators may be used to define basic operations in the gene 
expression data space 226, which can then be used to define more complex data analysis 
operations. 

For example, in a simplified gene expression data space with three dimensions: sample, 
20 gene, and expression measure type, a valuation fiinction, v, may be defined that returns the 

expression value of a gene, g, and sample, s. Where the expression measure type, E, is either Epa 
or EAbs, EpA measurements are either present, p. absent, a, or marginal/unknown calls, m, and 
EAbs measurements are absolute gene expression values, then: v (g, s, p) may be defined as "1" if 
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g is associated with a present call for s in Epa and "0" otherwise; v (g, s, a) may be defined as 
1 " if g is associated with an absent call for s in Epa and "0" otherwise; v (g, s, x) may be defined 
as "1" if g is present in s, "-1" if g is absent in s, and "0" otherwise; and v (g, s, abs) may be 
defined as the absolute gene expression value for g and s in EAbs- 
5 In addition, sample selections may be defined over the sample data space 222 in order to 

extract sets of samples with a certain profile. For example, a sample set may consist of male 
colon samples with adenocarcenoma from donors in the age group 40*60 that do not have a 
smoking history. 

^ Likewise, gene selections may be defined over the gene annotation data space 224 in 

ffO order to extract sets of genes with certain properties. For example, a gene set may consist of the 

h 

P genes on chromosome 22 whose protein products are involved in the estrogen metabolism 

M 

pathway. Gene and sample sets may be used in gene expression operations discussed below. 
Those skilled in the art should appreciate that analyzing gene expression data over 

Up 

irf arbitrary sets of genes and samples may not be biologically meaningful. For example, analyzing 
gj5 gene expression across samples firom different species may not yield biologically meaningful 
results. Consequently, gene and sample operations may need to be restricted in order to ensure 
that the resulting sets are consistent fi-om a gene expression analysis point of view. 

Furthermore, those skilled in the art should also appreciate that a gene expression 
summarization fimction can be defined over the entire sample and gene set dimensions or a set of 
20 genes and a set of samples, where the sample set has been specified using a sample selection and 
the gene set has been specified using a gene selection. 

Gene expression summarization on the sample dimension summarizes for each gene in 
the gene set, the gene expression measures over the samples in the sample set. For example, 
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given a gene set, G, and sample set, S, the gene expression summarization on S, results in 
expression summary a (g, e, S), for each gene g in G, and each e in EPA. Summary a (g, e, S) 
consists of the sum of expression measures over all samples of S for each pair g and e, i,e., o (g, 
e, S) = Sum [v (g, Si, e) | Sj in S]. 
5 Gene expression summarization on the gene dimension summarizes for each sample in 

the sample set, the gene expression values over all genes in the gene set. For example, given a 
gene set, G, and sample set, S, the gene expression summarization on G, results in expression 
summary o (s, e, G), for each sample s in S, and e in EPA. Summary a (s, e, G) consists of the 
sum of expression measures over all genes of G for each pair s and e, i.e., a (s, e, S) = Sum [v 
i%0 (gi, s, e) I gi in G]. 

y3 

C3 Gene expression averaging on the sample dimension averages for each gene in the gene 

M 

set, the absolute gene expression values over the samples in the sample set. For example, given a 
jlj gene set, G, and sample set, S, the gene expression value averaging on S, M (G, S), results in the 
fij set of mean expression values, \i (gi, S), for each gene gi in G, that is, M (G, S) == {|i (gi, S) | \i 

yi 

y 5 (gi, S) mean [v (g, Sj, abs) sj in S], & in G} . 

Having briefly described some basic operations using variants of OLAP operators, more 
complex data analysis operations may be defined. More particularly, consistently expressed gene 
operations may be defined over a set of genes and a set of samples to define the set of 
consistently present and consistently absent genes in a sample set. 
20 For example, in a given gene set, G, and sample set, S, the sets of consistently present 

("CPG") and consistently absent ("CAG") genes in S, may be defined as follows: 
CPG (G, S) - {gi I a (gi. p, S) card (S) and gi in G} ; CAG (G, S) = {gi | - a (&, a, S) = card (S) 
andgi in G}. 
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The set of inconsistently expressed genes ("lEG") may then be defined as: 
ffiG (G, S) = G - CPG (G,S) - CAG (G,S). 

Those skilled in the art should appreciate that sets CPG (G, S), CAG (G, S), and lEG (G, 
S) partition the set of genes G with regard to the way genes are expressed in sample set S, In 
other words, the sets are pair-wise disjoint. Other operations can be defined using the CPG, 
CAG, and lEG operations, particularly IPG (G, S), defining the genes that are inconsistently 
present in S, and lAG (G, 5), defining the genes that are inconsistently absent in S. For example, 
IPG (G, S) = lEG (G, S) u CAG (G, S); lAG (G, S) = lEG (G, S) u CPG (G, S). 

Similar operations may define the subset of samples in which the genes from a given 
gene set are either all present or all absent in a given sample set. For example, in a given gene 
set, G, and sample set, S, the subsets of samples of S in which all the G genes are consistently 
present ("CPS"), consistently absent ("CAS"), or inconsistently expressed ("lES") may be 
defined as follows: 

CPS (G, S) = {si I a (Si, p, G) = card (G) and Si in S}; 

CAS (G,S) = {si 1 - a (Si, a, G) = card (G) and Si in S}; and 

lES (G, S) = S - CPS (G, S) - CAS (G, S). 

hi one embodiment of the present invention, the CPG, CAG, CPS, and CAP operations 
may be varied using an additional threshold, T, for defining the gene expression consistency in 
terms of the minimum number of samples out of the total number of samples in 5, for which the 
genes are present or absent. 

In addition, derived operations can be used to contrast expressed genes in a set of samples 
with expressed genes in another set of samples. For example, in a given gene set, G, and sample 
sets, SI and S2: 
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for differentially expressed genes in set SI versus set S2: 
CPG (G,SI)nCAG (G, S2) 
defines the set of G genes that are consistently present in samples of SI and consistently 
absent in samples of S2; and 

CAG (G,Sl)nCPG(G, S2) 
defines the set of G genes that are consistently absent in samples of SI and consistently 
present in samples of 82; 

for unique consistently expressed genes in set SI versus set S2: 
CPG (G, SI) n IPG (G, S2) 
defines the set of G genes that are consistently present only in samples of SI (i.e., not 
consistently present in samples of S2); and 
CAG(G,Sl)niAG (G, S2) 
defines the set of G genes that are consistently absent only in samples of SI ; 
for common inconsistently expressed genes in SI and S2: 

CPG (G, SI) n CPG (G, S2) 
defines the set of G genes that are consistently present both in samples of SI and in 
samples of S2; and 

CAG (G,Sl)nCAG(G, S2) 
defines the set of G genes that are consistently present both in samples of SI and in 
20 samples of S2; and 

for common inconsistently expressed genes in SI and S2: 

IPG (G, SI) n IPG (G, S2) defines the set of G genes that are inconsistently 
present both in samples of SI and in samples of S2; and 
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lAG (G, SI) n lAG (G, S2) defines the set of G genes that are 
inconsistently present both in samples of SI and in samples of S2. 
Gene and sample correlation operations can be defined over a set of genes and a set of 
samples after gene expression summarization on gene expression value type has been applied on 
5 the gene expression data space 226, Gene correlation can be defined using a similarity, or 
distance, measure. The similarity of two genes, gl and g2, over a sample set S, is measured by 
the sum of | v (s, gl , x) - v (s, g2, x) | over all the samples of S. Accordingly, genes gl and g2 
are similarly expressed in S, if v (s, gl, x) = v (s, g2, x) for each sample s of S. 
^ Those skilled in the art should appreciate that gene and sample correlation can similarly 

CJO be used in grouping, or clustering genes and samples based on their similarity. 

h 

S3 Having briefly described the Data Warehouse 220 in accordance with embodiments of 

the present invention, a more detailed description of Data Management System 210 is set forth. 

ji^ Data Management Svstem 

W 

p In accordance with an embodiment of the present invention, gene expression data may be 

gj 5 generated in a high throughput production environment using Affymetrix GeneChip technology 

ru 

and READS proprietary differential expression profiling technology. QPCR may also be used to 
validate GeneChip and READS results. 

Large-scale data processing requires data management facilities for acquiring, 
organizmg, managing, integrating, and exploring massive amounts of data. Figure 2 illustrates a 
20 high level architecture of the present invention, including external data sources and repositories 
managed by data management system (DMS) 210. 

In accordance with an embodiment of the present invention, DMS 210 comprises 
operational databases and LIMS applications that support data acquisition and management of 
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production data. 

DMS 210 provides support for various sample acquisition and quality control protocols, 
via data entry, data migration, and reporting tools. The system uses domain specific vocabularies 
and taxonomies, such as SNOMED, to ensure consistency during data collection, and records the 
5 data in a database with a structure that is compatible with sample data space 222. 

In addition, DMS 210 provides support for high-throughput for Gene Logic's 
Affymetrix-based gene expression production and seamless integration with the Affymetrix 
GeneChip LIMS. 

DMS 210 manages gene expression experiment, QC/QA, and process data. In one 

P 

EJO embodiment of the present invention, gene expression experiment data generated by the 
□ GeneChip system are provided in files in Affymetrix proprietary formats: (a) a bmary image of a 
scanned microarray is contained in a DAT file; (b) the DAT file is converted to a CEL file using 

□ 

UJ 

« 

gj5 generates the expression values of gene firagments probed in the microarray. Finally, the 

iij 

GeneChip LIMS supports a publishing operation that tums the CEL and CHP files and process 
data into a relational representation based on the AADM schema and stores it in a transient 
database. 

DMS 210 integrates seamlessly the sample data management system with the GeneChip 
20 LIMS and a Chip QC module, thus ensuring data consistency across and efficient data flow 
through component data management systems. The Chip QC component is used for detecting 
chip image defects using both image software and manual visual analysis and for masking the 
probes affected by these defects. Furthermore, DMS 210 accelerates the rate of data generation 



a cell averaging analysis operation that generates average intensities for the probes on the 
microarray; and (c) the CEL file is converted into a CHP file by a chip analysis operation that 
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by providing support for parallel publishing via multiple GeneChip LIMS systems. 

Still referring to Figure 2, in accordance with one embodiment of the present invention, 
DMS 210 directs the data generated by the GeneChip LMS as follows: the DAT, CEL, CHP 
files are sent to Archive 230; the gene expression data, in relational AADM format, and the QC 
5 data are transferred to the DW 220 staging area where the necessary data integration, 

transformation, validation, and correction are performed before loading the data into DW 220. 
For example, in accordance with one embodiment of the present invention, consistency checks 
may comprise: matching filenames to sample names; matching filenames to array types; 
\xh preventing duplicated data; checking tissue type against a controlled vocabulary, such as 

ir,3lo SNOMED; checking that the CHP file contains the correct list of genes; checking that the 

f 

P number of cells are correct; and checking that no relative data is included. 

% Data management for READS and QPCR gene expression data may be provided by Gene 

\i 

Q Logic proprietary systems. READS and QPCR data are represented in a high-level object model 

yj 

p and are stored in relational databases. READS and QPCR files are also archived, while the data 
Ul 

in relational format are transferred to the DW 220 staging area where they are handled in the 

W 

same way as GeneChip data. 

Although a few specific embodiments of the present invention have been described in 
detail, it should be understood that the present invention may be embodied in many other specific 
forms without departing firom the spirit or scope of the invention as recited in the claims. 
20 The present invention pertains to relational databases for storing and retrieving biological 

information comprising an integration of at least three databases organized to support exploration 
and mining of gene expression data. The at least three databases include: (1) a gene expression 
database storing quantitative gene expression measurements for tissues and cell lines (from 
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hereafter both are termed bio-samples) screened using various assays; (2) a cUnical database 
which stores information on bio-samples and donors; and (3) fragment index is a comprehensive 
database of biological properties (annotations) for all fragments (full length genes and EST's). 

In a preferred embodiment of the present invention, the gene expression database for 
storing quantitative gene expression measurements from tissues and cell lines are screened usmg 
Affymetrix human, rat and mouse micro-arrays. It will be appreciated that the information in the 
gene expression database can preferably organized so as to meet specified quality control criteria 
and functional specifications. 

In a preferred embodiment of the present invention, the bio-sample specific information 
stored by the clinical database includes pathology, diagnosis, accrual and treatment facts. Donor 
information includes donor demographics, clinical histories for human donors and laboratory 
tests for animal models. Clinical data are recorded using standardized vocabularies compliant 
with established nomenclatures such as SNOMED. 

In a preferred embodiment of the present invention, the fragment index is a 
comprehensive database of biological properties (annotations) for all fragments (full-length 
genes and EST's) on the Affymetrix gene expression micro-arrays. Fragment annotations 
preferably include association to genes in the official HUGO nomenclature, links to related 
entries in public databases, and phenotype, structure, function and pathway information retrieved 
and digested from the public databases. 

The key objective of the relational database for storing and retrieving biological 
information of the present invention is to provide comprehensive access to gene expression and 
support for biological analysis. In the architecture of the present invention, these objectives are 
obtained by the query capabilities that the relational databases of the present invention provide. 
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as well as an application server that supports a biology-meaningful online analytical processor of 
the database data. This biology-meaningful online analytical processor examines large scale gene 
expression analysis of the data found in the relational database for storing and retrieving 
biological information so as to reveal gene expression patterns that characterize certain 
functional states of the physiology of an organism. Operations supported by the application 
server include filtering, clustering, summarization, comparison and mapping onto pathways of 
gene expression data. 

The functionality of the relational database for storing and retrieving biological 
information including its application server, is presented to users via the relational database user 
interface. In a preferred embodiment of the present invention, the relational database user 
interface is provided in two formats, the first as a web application and the second as a Java client 
application. 

The relational database for storing and retrieving biological information, the application 
server, a client side user interface and a users' workspace database, preferably define a three-tier 
architecture to gene expression data and analysis, hi a preferred embodiment, this system is 
integrated with an archive, an external file system that stores experimental data files and data for 
all experiments in the relational database for storing and retrieving biological information. 

The relational database for storing and retrieving biological information is the repository 
of gene expression data produced by a genomics production pipeline. A relational database 
management system is the backbone data management infirastructure that supports the data flow 
of the production pipeline. The relational database management system is a complex, distributed 
heterogeneous system whose main components are interfaced by software modules enforcing 
well-defined protocols. 
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The main components, preferably, of the relational database management system are: (1) 
a relational database management system; (2) a genomics production sample tracking system; (3) 
an application that documents the processes that generate the experimental files; (4) a software 
module that turns experimental files into a relational representation; and (5) a defect-inspecting 
5 software module. 

In a preferred embodiment of the present invention, the tissue repository information 
management system is an information system that supports the production cycle of a bio- 
repository, which support includes accessioning and inventory management of bio-samples, 
j,,! inputting pathology assessment and clinical data, and exporting of clinical data to the relational 
po database for storing and retrieving biological information. 

□ In a preferred embodiment of the present invention, the genomics production sample 

M 

tracking system consists of a collection of spread sheets which track samples as they move along 
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p J the production pipeline. In another preferred embodiment of the present invention, the 

w 

p application that documents the processes that generate the experimental files relates to the DAT, 

U1 

□5 CEL and CHP files for each experiment. This process documentation is preferably stored in an 

fu 

Affymetrix database. This application minimizes data entry overhead. 

In a preferred embodiment of the present invention, the software module that turns 
experimental files into a relational representation supports several parallel pubhshing engines 
and also performs a list of consistency checks to ensure that the production standard operating 
20 procedure and publishing processes were executed successfully. This software module also 
preferably dumps the individual databases into text files (per table) and transfers them to a 
designated area in a staging UNIX server. 

In another preferred embodiment of the present invention, the defect-inspection module is 
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a semi-automatic process in which chip images (DAT files) are inspected for defects that affect 
the quality of generated expression data. The result of this process are quahty control reports, 
one per experiment, that are also migrated to the staging UNIX server. 

The totality of these data streams defines the interface between the relational database 
5 management system and the relational database for storing and retrieving biological information. 
Specifically, all these data streams feed into a staging area where a warehouse building processes 
take place, i.e., validation, transformation and integration of the data. 

The migration of data firom the various data sources to staging is controlled by data 
migration protocols. In a preferred embodiment of the present invention, these data migration 

g^O protocols include an expression data migration protocol; a tissue repository information 

41 

23 management system for clinical data; and a chip-defects migration protocol. 

t\l The expression data migration protocol, preferably, includes daily publishing 

« documented by an email report; pubHshing data (per publishing engine) by dumping into TXT 

d 

[i^ files (one per each gene expression data table) and a LST file; verifying line counts of the TXT 
j-js files; copying files to pre-staging (an incoming directory on the UNIX server) by an ftp process; 
notification by the publishing operator to the staging DBA that the ftp process is done upon 
completion of the ftp process; verification by the staging DBA of the line count of files; loading 
to staging concluded with a loading report emailed to the relational database for storing and 
retrieving g biological information; and staging protocol triggers with I day (24 hrs) fi-om the 
20 loading time. 

A preferred embodiment of the present invention utilizes data integration, a process of 
bringing together experimental data generated by parallel and independent publishing processes. 
Parallelism in publishing is introduced to satisfy high-throughput requirements and to permit 
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generation of experimental data files in different facilities. 

This data integration serves to scan and validate AADM published data and to adjust 
identifiers generated by parallel publishing processes in a sequential order, this data integration is 
extensible, in the sense that process specific validation rules can be added and enforced by the 
5 system. 

In another preferred embodiment of the present invention, gene expression I integration is 

also provided. Gene expression integration refers to the integration of experimental data with 

clinical and public gene data (Fragment Index). Gene expression integration is a task performed 

1^* at the staging database. 
C3 

gjo The present invention is further characterized by a database schema. This schema itself 

^3 

□ can preferably be divided into four related sub-schemas: (1) probe array design; (2) experiment 

H« setup; (3) analysis results; and (4) protocol parameters. 

^ With regard to probe array design, this part of the schema holds data describing a probe's 

q array physical and biological design. The most important part in this sub-schema, is the 

yi 

g|5 association of biological items (gene fragments) to blocks in a particular probe array type. Probe 

11J 

array types are recorded in the PROBE_ARRAY_DESIGN table. A PROBE_ARRAY_DESIGN 
instance describes the physical layout of an expression chip type. PROBEARRAY_DESIGN is 
related via the ANALYSIS_SCHEME relationship to a SCHEME^UNIT entity. Although, the 
general design goal in data integration is to be able to attach several "logical" designs to a 
20 physical chip design, in the case with expression probe arrays there is a one-to-one relationship 
between physical and logical design. This translates to a one-to-one correspondence between 
SCHEME_UNITS and SCHEME_BLOCKS. Each block interrogates a single gene firagment. A 
block unit is divided into atoms, hi gene expression probe arrays, an atom consists of two cells. 
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Each cell corresponds to 25-mer oligonucleotide probe. A block representing a gene fragment 
consists of approximately of 20 probe pairs, each probe pair corresponding to an atom with a 
perfect match and a mismatch probe cells. 

The AADM probe array design sub-schema contains parts that are not used/needed in any 
5 gene expression exploration queries. The intention for this sub-schema was to hold a variety of 
Affymetrix probe array designs and therefore is used the Affymetrix analysis software to relate 
probe intensities to biological items. 

The experiment setup sub-schema holds information on the probe arrays used and the 
j^j^ target applied in any gene expression experiment. An EXPERIMENT is the event during which a 

a 

CJO physical chip and a target are "joined". As the target is applied on a chip probes of the chip 

yj 

P hybridize with gene regions of the target. The chip surface is scaimed to generate a DAT file 

he 



□ 
w 

□ 



where the hybridization result is permanently printed. Subsequently the DAT file is analyzed in 
order to extract useful biological data. An experiment is controlled by a protocol. A protocol 
dictates how the experiment should be conducted and which captures administrative information 
and data about the environmental conditions during the experiment. The database, by capturing a 
record (or object) per experiment run, enables the association between experimental results, 
tissues that are processed into targets, and resulting datasets (via the DAT). 

A TARGET is prepared out of a bio-sample and therefore is the connecting entity 
between experiments and sample specific information. This association in AADM is very 
20 limiting since it only supports one parameter to describe the target and this is the 
TARGET_TYPE. 

A PHYSIC AL_PROBE_ARRAY (chip) is the physical apparatus used to carry out the 
hybridization and scan experiment. A physical chip is identified by a serial number, belongs to a 
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particular probe array design and has an expiration date. 

The analysis results sub-schema stores results from various analyses, including cell 
averaging, absolute gene expression and comparative gene expression analysis. It is preferred to 
use cell averaging and absolute gene expression analyses, only. 
5 The analysis process v^rorks as follows. A hybridization/scan experiment generates an 

image file, call the DAT file. The DAT file is analyzed and the its quantitative representation, the 
CEL file, is generated. This analysis is called cell analysis. Cell analysis first fits a grid to 
separate the cell (which correspond to probes) of the image and second calculates the average 
j,^ intensity value for all pixels in a cell. In AADM the results of cell analysis are stored in the 
□10 MEASUREMENT_ELEMENT_RESULT table (MER for short). A subsequent analysis step, 

S3 called chip analysis, performs "expression calling" on the CEL file. The result of this process is 

M 

4'* an assertion of gene expression of all gene fragments on the chip that includes the average 

P intensity and a presence/absence (P/A) call. The results of the chip analysis are stored in the 

p ABSGENE_EXPR_RESULTS table (ACER for short). The ANALYSIS table in the schema 

!J1 

gj5 stores an analysis record for any analysis performed. An analysis record is identified by an 

HJ 

analysis id (key) and is related to: the protocol used for the analysis, an analysis scheme (and 
transitively a chip type), the algorithm, analyst and the dataset on which the analysis is 
performed. An analysis record also stores the date and a name for the analysis. 

Input data set(s) to analysis are recorded in the ANALYSIS_DATA_SET table. Data sets 
20 are grouped in collections of data sets. AADM uses the ANALYSIS_DATA_SET_ 

COLLECTION table to unsuccessfully model a many-to-many relationship between analyses 
and analysis data sets ANALYSIS_DATA_SET stores a record for each type of analysis, i.e., 
cell analysis and chip analysis. In cell analysis the input data set is an experiment (DAT file). In 
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chip analysis the input data set is an analysis. With regard to the protocol parameters, this sub- 
schema contains parameters captured during, the experiment setup, hybridization experiment, 
and cell and chip analyses. The data in this sub-schema are essential for the production and 
quality control groups who want to track the data generating processes. The relational database 
for storing and retrieving biological information also uses values of certain protocol parameters, 
such as the version of the production standard operating procedure, in order to partition 
expression data into meaningful and comparable subsets. 

In a particularly preferred embodiment, the present invention provides a staging database. 
This staging database is an area where several warehouse building processes take place. The 
staging database is, preferably, an Oracle database ruiming on a UNIX server which also 
functions as the pre-staging area where several ftp processes deposit data produced by the data 
management tool. 

In utilizing such a staging database, it is preferable to run a staging protocol. In such a 
staging protocol expression data in staging are processed and transformed. The staging protocol 
is a routine of steps that are performed each time expression data are loaded from pre-staging 
into the staging database. The staging protocol expects that expression experiments are named 
according to the nomenclature defined in the publishing SOP version 3.0. Preferably, a valid 
experiment name is a 13 characters long string, nnnnncccccccsr, where 



nnnnn 


is the 5 digits genomic number (e.g., 00231) used by production to 
track a sample 


cccccc 


is a six character string that represents the chip type used in the 

experiment, e.g., Hu35KA 


r 


is a single digit number representing the repetition count that the 




same genomics sample has been hybridized on a chip^ 




is a single digit number representing the scans count of the same 
chip 
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The staging database permits extensions to allow the management of other specific 
practices not identified above. For example, the passage of experiments through staging can be 
tracked using the GLGC_EXPERIMENT table. The steps that the staging protocol takes depend 
whether production does a single or double scan per chip. In the case of double scans, the staging 
5 protocol classifies the scan into a primary and a secondary, consolidates the expression 
presence/absence calls of the secondary into the primary and migrates the primary into the 
warehouse. 



Another optional step of the staging protocol depends on the type of probe pair generated 
during this process. One option is to generate "digested" probe pair data containing the probe- 

P 

00 level cell intensities as well as the summarized expression call of all probes per an Affymetrix 

9 

B gene fragment. The second option is to simply store cell intensities of probes per experiment into 

M 

"1^ separate comma delimited text files. The steps of the staging protocol are: (1) export and backup 
L the staging database; (2) check consistency of data files in the incoming directory; (3) load data 
f'l into the data integration tables; (4) update the GLGC_EXPERIMENT table; (5) compute the 

lii 

gJ5 rank (primary/secondary) of experiments with multiple scans; (6) consolidate primary and 
secondary experiments; (7) migrate primary experiment data into the relational database; (8) 
generate the "digested" probe pair data; (9) delete migrated data; (10) generate statistics about 
the staging activity; and (11) export and backup the staging database. Steps 1, 2, 3, 4, 7, 9, 10 
and 11 are compulsory. Steps 5 and 6 refer to the double scan situation. Step 8 applies only if 
20 "digested" probe pair data are calculated, otherwise plain probe pair data are generated in step 2. 

The experimental data migrated to the relational database are the summarized expression 
calls per gene fragment, i.e., the AGER table, and not the probe intensities, the MER table. The 
probe intensities are stored in text files named by the experiment name and directed to the 
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archive. 

Another important function of the staging database is expression data integration, i.e., 
linking the expression data with the clinical database and the fragment index. Although these 
data will physically "get together" in the relational database, the staging database adds this 
5 capability. Specifically, for clinical data, it decodes the experiment name and extracts the 
genomics sample number out of it. This number is associated with the bio-repository id and 
hence the sample and clinical information, through the BI0_2_GEN table exported by the 
production tracking system. Table GLGC_EXPERIMENT associates the genomics number to 
the ANALYSIS_ID for both the cell and chip analyses performed to this experiment, then a 

P 

CJO referential integrity constraint ensures that the corresponding data records exist in the AGER and 

f 

P MER tables. The constraint to the MER table is disabled in GXDB, because MER data are not 

*|; available. 

T 

p Fragment index integration is a task directly done in the relational database. The 

fragment index, by design, maintains a list of gene fragments, a.k.a. items, exactly in the same 

U1 

□5 order as the items in the AADM BIOLOGICALJTEM table. The addition of a foreign key 

w 

constraint from AGER to the fragment index AFFY_ITEM table, provides for integration. 

Additional integration tasks include the masking of defective gene fragments on chips out 
of experimental data and enforcement of the sample completion constraint. The chip quality 
control identifies defective spots in the scanned images that should not be incorporated in cell 
20 and chip analyses. The quality control process reports the gene fragments per experiment that are 
affected by image defects, in files that are transferred to the pre-staging area. These files are used 
to mask out expression data points by turning the Present/Absent (P/A) call to Unknown (U). 
The old P/A called is saved and can be restored anytime the quality control report is reverted. 
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Working with chips grouped in sets, such as the Human 42K set, requires running the 
same genomic sample over several chips. In order to complete a vector of 42K expression data 
points for each sample, data from all 5 chips need to be in the database. The process of getting all 
chips per sample in order to make a complete expression vector is called sample completion. A 
5 preferred embodiment of the present architecture allows enforcement of sample completion at 
staging, at the relational database, or not at all. 

In a preferred embodiment of the present invention, during loading, data are checked for 
consistency. The consistency rules preferably applied are a subset of the rules checked in 
publishing before the migration to pre-staging. The following rules are preferably applied per 

□ 

CSo experiment/chip basis. 

iJ5 



Rule name 


Description 


name consistency 


verifies whether the experiment name 
complies with the naming nomenclature. 


chip type consistency 


verifies whether the chip type name 
component of the experiment name is one 
of the chip type names in the controlled 
vocabulary (e.g., Hu35KA) and the 
corresponding Affymetrix chip type name 
(e.g., Hu35KsubA) exists in the database. 


cell cardinality 


checks whether the number of rows in the 
MER table matches the expected number 
of rows for the same chip type. 


gene cardinality 


checks whether the number of rows in the 
AGER matches the expected nimiber of 
rows for the same chip type. 


chip correctly analyzed 


A chip that is analyzed, for instance, as 
Hu35KsubA must be of type Hu35KsubA. 


correct project name 


the project name of the experiment must be 
part of the experiment names controlled 
vocabulary. 


mask consistency 


verifies whether the proper mask library 
(specified in the SOP) has been applied 

during analysis. 


chip already loaded 


the same chip experiment has already been 
loaded in staging 


correct genomic id 


verifies that the genomics sample number 
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registered in experiment setup matches the 
genomics sample number in the experiment 
name. 


correct SOP version 


verifies that the production standard 
operating procedure entered is the standard 
operating procedure in effect for the 
date/time of the experiment 


valid target type 


verifies that the target type value is a valid 
tissue type. 


valid dates 


Dates in EXPERIMENT and ANALYSIS 
tables are earlier than current date, but not 
more than six months apart. ANALYSIS 
date is later than EXPERIMENT 



In another preferred embodiment of the present invention, the staging database is a proper 
relational database with SQL query capability. The staging database preferably also provides 
reports to track the staging activity. Such reports include a staging loading eport, issued any time 
loading to the staging database occurs; a staging weekly report which reports the staging activity 
per week, i.e., number of experiments loaded in, number of experiments migrated to the 
relational database, etc.; and a staging weekly exception report which reviews double scan 
experiments, and reports the experiment names of experiments waiting for the "mate" scan (are 
on hold) for longer than 5 days. 

In another preferred embodiment of the present invention the relational database provides 
extensions to support the Gene Express process model. List of AADM tables 



ABS_GENE_EXPR_ ATQM_RESULT 

ABS_GENE_EXPR,_RESULT 

ABS_GENE_EXPR_RESULTJYPE 

ALGORITHM^TYPE 

ANALYSIS 

ANALYSIS_ALGQRITHM 

ANALYSIS_DATA_SET 

ANALYSIS_DATA^SET_COLLECTION 

ANALYSIS_DATA SET^TYPE 

ANALYSIS_SCHEME 

BIOLOGICAL ITEM 
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CHIP_DESIGN 

EXPERIMENT 

MEASUREMENT ELEMENT _RESULT 

PARAMETER 

PARAMETER TEMPLATE 

PARAMETER_TYPE 

PARAMETER_UNITS 

PHYSICAL_CHIP 

PROTOCOL 

PROTOCOL^TEMPLATE 

REL_,GENEJXPR_RESULT 

REL_GENE_EXPR _RESULT JYPE 

SCHEME ATOM 

SCHEME_BLOCK 

SCHEME_CELL 

SCHEME_UNIT 

TARGET 

TARGET TYPE 

TEMPLATE^TYPE 

UNIT TYPE 



An aspect of the present invention is ensuring the data integrity of the data in the 
relational database for storing and retrieving biological information. Database referential 
integrity maintains the relationships of the data modeled in the database schema. Various 
application-specific rules and general biological rules need to be constructed in the data. This is 
accomplished by identifying the application-specific rules and general biological, translate the 
^plication-specific rules and general biological represent rules into PL/SQL fimctions, and store 
the resuhant functions in a rule base within the relational database for storing and retrieving 
biological information. It will be appreciated that these application-specific rules and general 
biological fimctions will periodically be run by the relational database rule engine to ascertain 
the accuracy and integrity of the data stored in the relational database. 

It will be appreciated that there are several application-specific rules and general 
biological rules appropriate for use with the relational database for storing and retrieving 
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biological information. Exemplary rules include chip consistency rules; chip defects report 
consistency rules; clinical data/gene expression data consistency; Fragment/gene expression data 
consistency rules; and expression integrity rules. 

Chip consistency rules assess the microarray for consistency and are preferably checked 
5 at the time of publishing and data staging. Chip defects report consistency rules assess the chip 
defects report for consistency. For example, the gene fragment names in the chip defects report 
per experiment should match the gene fragment names of the chip type in the experiment. 
Clinical data consistency rules assess the internal consistency of the clinical data. Clinical 
j,i data/gene expression data consistency assess the consistency of the clinical data with the gene 

a 

0 expression data. For example, the organ name in the clinical database should match the target 

f 

0 type value in the gene expression data for the same sample. Matching is preferably performed at 
variable granularity, i.e., organ "cerebellum" matches target type "brain". Fragment/gene 
expression data consistency assesses the consistency of the fragment index data with the gene 
expression data. Preferably, this rule verifies that the ID and ITEM_NAME in 

w 

□5 BIOLOGICAL JTEM joined with the ANALYSIS_^SCHEME.ID, matches the ITEM_ID, 
AFFY_NAME and ON_CHIP attributes of the fragment index's AFFY_NAME. Expression 
integrity rules are based on biological knowledge. For example, if a gene is known to be present 
in a specific tissue type, then it should be present in the relational database. Special classes of 
this rules handle the housekeeping (or spiking) genes for which there is prior knowledge as of 
20 whether they are present or absent. Figure 8 represents an embodiment of the integrity constraint 
enforcement system of the present invention. The application-specific rules and general 
biological rules are organized by modules, 801 and 802, and are stored in the Rule Repository 
800. When an application-specific or general biological function is run and an error is detected, 



D 
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then the system generates an error codes and/or corrects the error by means of the error engine 
803. In addition, a log and audit engine 804 creates a log and audit of the run. 

Although the relational database for storing and retrieving biological information accepts 
data by experiment, the user preferably views data by sample. In a preferred embodiment users 
will have a restricted view of samples, based on ownership and authorization. Data in the 
relational database for storing and retrieving biological information are preferably organized by 
partitions, access rights. Furthermore, data partitions may be cloned out of the relational database 
into separate, smaller access group-specific databases. A sample data vector in the relational 
database refers to all the data attributed to a sample, e.g., for the Human 42K a sample data 
vector would contain all the 42K data points that are generated in 5 chip experiments. Because 
there can be several runs on the same sample, there can be several data vector candidates in the 
relational database per sample. One such scenario is listed in the table below where genomics 
000 1 2 has 3 possible data vectors 



Experiment Name 


Data Vector Candidate Group Identification 


00012Hu35KA12 




000i2Hu35KB12 




00012Hu35KC12 




00012Hu35KD12 




00012Hu35KE12 




00012Hu35KA22 


2,3 


00012Hu35KB22 


2,3 


00012Hu35KC22 


2,3 


00012Hu35KC32 


2,3 


00012Hu35KD32 


2,3 


00012Hu35KE32 


2,3 



Partitioning is the process by which sample data vectors are segregated according to 
partitioning schemes or partitioning types. For example, sample data vectors can be partitioned 
according to project, tissue normality (diseased or normal), organ, collaboration, etc. Partitioned 
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sample data vectors can restrict access to specific users. 

The construction of primary data vectors per sample is done automatically using heuristic 
rules defined by production, or by manually overriding the automatic grouping. For example, if 
more than one chip of each type, e.g., two A chips, are available per sample, the one with the 
higher run number goes into the primary vector. The experiments groups defining sample data 
vectors are stored in a table 
EXPERIMENT GROUP. 



GROUP ID EXPERIMENT ID STATUS 



MASK 



CMASK 



□ 

□ 

S3 

□ 
yi 
« 



Attributes MASK and CMASK are used for partitioning. Their values are based on the 
partitioning properties for a given sample. The CMASK attribute is used for filtering the data for 
requests firom users and the MASK attribute is a numeric value that can be used for physically 
partitioning (Oracle 8 partitions) the schema. When a sample should not be in a particular 
partition, these attributes take default values that make the sample data vector a component of the 
global partition. This is best understood with the help of examples. The following example 
illustrates how possible partitioning variables with their values and a numeric code are used to 
form parts of the mask. 



Collaborator 


Project 


Organ 


Normality 


JTI 


HPRl 


Heart 1 


Malignant 1 




HRD2 


Liver 2 


Normal 2 




MPR3 


Kidney 3 






MRD4 







Let N be the total count of values for an attribute, let genomics 00120 be accessible only 
to JT and let the tissue be derived fi-om a malignant kidney. Then it would 
20 have the mask 
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Collaborator 


2 


code for JT 


Project 


0 


no project specified 


Organ 


3 


Kidney 


Normality 


1 


Malignant 



Then, CMASK would take "01000301". MASK would have the value (01 00 03 01) base N. In 
another embodiment of the present invention, the clinical database is built on an Oracle 8i 
database server. 

The tissue repository information management system is the information system that 
manages the bio-repository. In addition, to being an inventory system, this system provides data 
entry tools for pathology and clinical records of bio-samples. The tissue repository information 
management system preferably runs on a MicroSoft Access back-end database, A server side 
script preferably exports the data from the Access database files as ASCII text files. These files 
are then transferred, preferably by means of ftp, to the pre-staging area and then loaded on the 
staging database for clinical data. During loading, the integrity of clinical data is checked 
through a list of rules, such as donor age should be in the range of [1, 99], weight should be 
expressed in metric system units, etc. 

Only a subset of the data from the tissue repository information management system is 
needed for the clinical database, and the loading protocol preferably selects only those that are 
appropriate. After all the checks return successfrilly, new data is migrated to the relational 
database. 

The schema for the tissue repository information management system can be 
preferably divided into three data units: (1) tissue details; (2) donor attributes; and (3) controlled 
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vocabularies. 

Sample detail attributes are organized in the BIOSAMPLE and FRAGMENT tables. 
BIOSAMPLE holds tissue specific attributes such as SITE (accrual site), SOURCE (accrual 
source), ORGAN_NAME. HISTOLOGY, PATIENT_DIAGNOSIS, and 
5 PATHOLOGY_DIAGNOSIS. BIOSAMPLE captures information about physical bio-sample 
entity. 

A tissue FRAGMENT is a physical fragment of a bio-sample. These fragments are run 
through the experiments and are assigned a unique GENOMICS number. The FRAGMENT 
table also holds other attributes of the fragment such as WEIGHT_ACTUAL (actual weight in 
Z%0 metric units i.e., kg), WEIGHT_ESIMATED. Organ name and histology fields relate to a 

as 

S3 standardized terminology, such as found in SNOMED and take values from a controlled 

% vocabulary (CV). Similarly, the diagnosis field relates to SNOMED and have an associated CV. 

Q A main table is DONOR. It has human donor attributes that that span various domains: 

W 

□ general attributes such as HEIGHT, WEIGHT, RACE, DATE_OF_BITH; deceased fields such 
U1 

D5 as DEATH_CAUSE, DEATH_AGE; sparse data fields such as exercise habits, diet profile, 

m 

sleeping and smoking habits, alcohol and any recreation drug habits. 

The DONOR fact table is preferably linked to five other detail tables: 
HISTORY_FAMILY - donor family diagnosis; HISTORY_MEDICAL - patient medical history; 
HISTORY^SURGICAL - patient surgical history and anesthesia (in 
20 HISTORY_SURGICAL_ANESTHESIA); HISTORY__MEDICATION - patient medications 
history; and HISTORY_LAB_TEST - patient lab test history. 

An attribute that links the clinical database to other components is the genomics 
identification number. All fragments run through the chip gene expression get a unique genomics 
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identification number. These identifiers are assigned during sample preparation and form a part 
of the experiment names. The genomics identification number is also stored in the fragment 
table. The ABS_GENE_EXPR_RESULT, ANALYSIS, EXPERIMENT, 
GLGC__EXPERIMENT tables in the gene expression data schema have the BIOSAMPLE_ID 
field that contains the sample Jd in the clinical database for experiments run through the 
corresponding samples. This process is done as a part of the clinical data loading protocol, a 
stored procedure updates the above tables on the production database to do the job. The same 
stored procedure script is also run when new experiments are published to the production 
warehouse. 

The relational database of the present invention preferably utilizes a three-layer archiving 
system. The three layers are: (1) an on-line network disk file system; (2) near-line storage; and 
(3) off-line DLT tape backups The on-line network disk file system is based on a network disk 
system (Network Appliance F720). The network file system is also visible to the NT network. 
The disk space is organized into two partitions: one for archiving and one for building data 
distributions. A complete set of information for each sample in a file system accessible fi-om both 
UNIX and Windows is maintained. The information is organized by genomics identification 
number and can be fiirther broken down by experiment name. By storing the information in this 
directory structure, it is easier to build distribution sets based on filtering requirements. The near- 
line storage is based the HP Superstore magneto-optical jukebox and serves as the backup device 
of all data files generated by production and is also the backup of the on-line archive. 

Off-line DLT tape backups are used to backup the pre-staging directories, the database 
servers and the on-line archive. 

Another aspect of the present invention is modifying the database to utilize new chipsets. 
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It will be appreciated that periodically new gene chips for analyzing gene expression in tissues 
from various species will be available; these are preferably grouped in chipsets of 3 to 5 chips. 
Preferred gene sets include the Hu42K set for humans, the Mul 1 K set for mice, and the 
RG_U34 set for rats. Another preferred gene set is the Affymetrix HG_U95 chipset, also known 
5 as the 60K set (because the five chips in it represent about 60,000 gene fragments). 

Although most of the gene fragments represented in the two human gene sets have 
counterparts, the oligonucleotides used to probe each fragment may differ between the two sets. 
In such circumstances, cross-chipset analysis is not available; gene sets may not contain a 
mixture of gene fragments from different chipsets. Further, sample queries are preferably 

0 

GJO restricted by chipset as well as by species; all samples in the sample set must have experiments 
0 from chips of the chipset that was selected when the query was run. The chipset used to qualify 

the sample query is saved as an attribute of the sample set. 
JL- Additionally, analyses are restricted by the chipset associated with the sample sets that 

P are input for the analysis; when multiple sample sets are input, the sample sets must have all the 
Q5 same chipset attributes. The gene sets that are generated by the analysis will be filtered to contain 
only gene fragments for this chipset. Another aspect of the present invention is normalization of 
the data. Normalization makes the expression values reported from different gene chip 
experiments comparable to one another, so that if two different samples yield the same 
expression value for a gene fragment, there is reasonable confidence that the concentrations of 
20 mRNA transcripts for the fragment are the same in the two samples. Because of variations in the 
manufacturing process for the chips, as well as other factors, the unnormalized intensity values 
vary widely from one chip experiment to another for fragments with the same RNA 
concentration. 
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There are a number of preferred methods for adjusting for this variation. Preferably, the 
present invention supports three methods: scahng, normalization, and standard curve 
normalization. In scaling, average differential intensity values (or "AveDiffs") are generated as a 
result of this normalization process. The normalized values are computed by multiplying the 
unnormalized values by a scale factor. The scale factor is the same for all values in an 
experiment, and is calculated as follows: 

1. Take all the unnormalized AveDiff values in the experiment. Throw away the largest 
2% and the smallest 2% of the values. That is, if the experiment yields 10,000 expression values, 
order the values and throw away the smallest 200 and the largest 200. 

2. Compute the "trimmed mean," equal to the mean of the remaining values. 

3. Compute the scale factor SF = 100/(trimmed mean). 

Another normalization method is based on the observation that the expression 
intensity values from a single chip experiment have different distributions, depending on whether 
small or large expression values are considered. Small values, which are assumed to be mostly 
noise, are approximately normally distributed with mean zero, while larger values roughly obey 
a log-normal distribution; that is, their logarithms are normally distributed with some nonzero 
mean. While scaling applies the same scale factor to all expression values in an experiment, 
normalization computes separate scale factors for "non-expressors" (small values) and 
"expressors" (large ones). The inputs to the algorithm are the scaling AveDiff values, which are 
akeady scaled to set the trimmed mean equal to 100. The algorithm computes the standard 
deviation SD noise of the negative values, which are assumed to come from non-expressors. It 
then multiplies all negative values, as well as all positive values less than 2.0* SD noise, by a 
scale factor proportional to 1/ SD noise. Values greater than 2.0* SD noise are assumed to come 
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from expressors. For these values, the standard deviation SD log(signal) of the logarithms is 
calculated. The logarithms are then multiplied by a scale factor proportional to 1/ SD log(signal) 
and exponentiated. The resulting values are then multiplied by another scale factor, chosen so 
there will be no discontinuity in the normalized values from unsealed values on either side of 
2.0* SD noise. 

A third normalization method is termed "standard curve normalization" or sometimes 
"spike-in normalization." This normalization method relates the original expression intensity 
values from the chip experiments to actual mRNA concentrations for each gene expressed in the 
sample. In order to do this, known concentrations of particular gene fragments must be "spiked 
in" to the sample RNA mixture before hybridizing it to the chips. (Bacterial genes are used for 
the spike-ins, so there will not be any additional RNA contribution from the sample donor.) 

The chip experiment yields intensity measurements for the spike-in gene fragments. 
Ideally, the intensities will increase linearly with concentration; therefore, if intensity is plotted 
vs. concentration, it should be possible to draw a straight line through the origin connecting the 
data points, and use its slope to infer the mRNA concentrations for the other gene fragments on 
the chip. In reality there are noise and non-linear effects which distort this relationship; but one 
can still draw a straight line through the origin that is the best fit to the data points. The straight 
line is known as the "standard curve." To perform standard curve normalization, the runtime 
engine (RTE) loader fits a standard curve for each chip experiment for which spike-in data is 
available, and divides the intensity measurement for each gene fragment by the slope of the 
standard curve to obtain a concentration value. (Negative values and values below a certain 
sensitivity cutoff are mapped differently; this mapping is described in a separate document.) The 
concentration value (in picomoles) is reported as the expression value, rather than the intensity. 
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Because only a portion of the samples may have spike-ins, the RTE will not generate 
concentration values for samples that do not have spike-ins. Therefore, when running an analysis 
tool such as Fold Change, if the standard curve normalization is selected, the present invention 
checks to see if all the samples in the input sample sets have sufficient spike-ins. If not, the 
S database will issue a warning that certain samples cannot be used in the analysis and will 

terminate the computation. Additionally, concentration values fall in a different range (typically 
smaller) than intensity values, thus, it is necessary to use a smaller threshold when filtering the 
standard curve normalized data. 



1^6 Another preferred embodiment of the present invention is a configuration of the database 

0 

EJO in combination with gene expression data obtained from restriction enzyme analysis of 
^0 

0 differentially expressed sequences ("READS"). Certain samples fi'om toxicology experiments 

M 

"j; are processed using both platforms. The chip data are stored in the gene expression database. The 

p READS data are stored in a separate database, known as ToxREADS. In a preferred embodiment 

U 

p of the present invention, links are created from certain data values in the database of the present 

ijl 

□5 invention to related ToxREADS data. 

Most toxicology experiments are performed within the context of studies, in which 
groups of experimental animals or cell cultures are subjected to various treatments, and samples 
are collected from them at different time points post-treatment. For example, a study may 
examine the effect of two different doses of a toxin on rat livers at three different time points, 
20 compared to livers from saline-injected rats at the same time points. In order to improve the 
quality of the data, replicate experiments are performed; that is, several animals are treated with 
the same dose and sampled at the same time point. Each group of samples from replicate 
experiments is known as a study group. The Sample Set query tool allows you to search for 
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samples belonging to a study and group them by study group. 

READS data are derived from electrophoresis gels in which processed mRNA fragments 
from samples in different study groups are run on different lanes of the gel and separated by 
fragment length. Differentially expressed fragments, represented by bands that are darker in 
5 some lanes of the gel than others, are cored, sequenced, and matched to known genes if possible. 
As discussed above, data for these fragments, such as a measure of the intensity of the band, are 
stored in the ToxREADS database. Some of these gene fragments found in READS gels (known 
as READS fragments) may also be represented on one or more gene chips. In this case, 

^ expression data may be available from both platforms. Preferably, a link is created from the gene 

□ 

□o expression database data display to a ToxExpress report, so that the READS data and chip data 

f 

P may be viewed side by side. 

It is important to note that expression data for READS fragments are only meaningful 



within the context of a particular study; thus, a user must choose the study he or she is interested 

in. When the user selects to add a ToxREADS link, the tool preferably displays a dialog box 

U1 

p5 listing the available studies. The user then selects one or more studies from this Ust and clicks the 

lU 

Add button in the dialog; the results table will then display an additional ToxREADS link 
column for each study selected. The ToxREADS link colunrn displays an arrow icon for each 
gene fragment in the query results that is associated with a READS fragment in the study for that 
column. When the user clicks on this icon, the gene expression database directs the user's Web 
20 browser to navigate to the report page for the corresponding READS fragment in the associated 
study. Each lane of a READS gel (and therefore, each band corresponding to a READS 
fragment) may be derived from several individual samples that are pooled together. Typically, 
the samples in each study group are pooled together, so that there is one READS sample per 
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study group; further, the control samples for different time points (which are stored in the gene 
expression sample database in separate study groups) are pooled together into one READS 
control sample. 

To make it easier for users to relate individual samples to pooled READS samples, 
5 ToxExpress users are preferably provided with a collection of predefined sample sets. These are 
organized under subfolders for each ToxExpress study; each sample set contains the samples 
corresponding to a pooled READS sample. When the user clicks on a ToxREADS link in gene 
expression database, a report is preferably displayed showing information about the READS 
|,i fragment associated with a selected gene fragment within a particular study. The rows of the 
Elo table may correspond to different pooled READS samples in the study; the rightmost columns 



J3 

n 

P 

yj 



may show the expression intensity value from each READS experiment, and the mean 
expression values (with both scaling and normalization) from the corresponding chip 
experiments. Some of the fields in the table (e.g., READS Fragment) may have arrow icons 
associated with them. These can act as links to detail reports. For example, when the user clicks 



□5 on the icon next to a READS Fragment name, the user's Web browser navigates to the detail 

h 

report for that READS fi-agment. 

Each READS Fragment detail report preferably contains a link to a chromatogram trace 
file. In order to view this file, the Web browser must be configured to launch a program capable 
of reading and displaying the file. Another aspect of the present invention is a gene signature 
20 analysis. A gene signature analysis of a sample set extracts two sets of gene firagments from all 
of the gene fragments represented in the sample set's chipset: those that are consistently 
expressed within the sample set, and those that are consistently not expressed. In order to 
perform the gene signature analysis, it is necessary to quantify the "consistency" of expression as 
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two threshold percentages, one for the "present" set, the other for the "absent" set. Consistency 
of expression is a measure of how much a gene (fragment) is expressed, or not expressed, in a 
sample set. For example, if there are 5 samples in the sample set, and the user sets the present 
and absent threshold percentages to 80% and 80%, respectively, then the gene signature analysis 
5 computes one set of genes that are present in at least 4 out of 5 samples, and another set which 
are absent in at least 4 of 5 samples. There are a variety of ways in which the result of the gene 
signature analysis can be displayed. After the analysis is complete, the results are preferably 
displayed in the summary tab of the gene signature analysis window. This window preferably 
presents a panel displaying the number of gene fragments in the present gene set; a panel 

O 

00 displaying the number of gene fragments in the absent gene set; and the name of the sample set 
53 and the number of samples it contains. Default summary columns preferably include 

GenomicslD, Experiment(s), Total Present Calls, Total Absent Calls, Total Unknown Calls, 
Present Calls (Present Gene Set),Unknown Calls (Present Gene Set), Absent Calls (Absent Gene 
Set), and Unknown Calls (Absent Gene Set). At the bottom of the window, the Gene Signature 



p5 History is preferably displayed. This presents information about the thresholds used to compute 

iij 

the analysis, the date and time the analysis was performed, and the version of the Runtime 
Engine (RTE) used for the analysis. 

hi another embodiment of the present invention, the display of the gene signature analysis 
permits display of details regarding the gene signature analysis. The options preferably include 
20 Sample Detail, Attributes, Experiments, Sample, Donor, and Display Options. In another 

preferred embodiment, it is possible to export the summary into an Excel worksheet, export the 
sunmiary into a Web browser, or print the summary. 

In viewing the gene signature curves, there are preferably two display options: Number of 
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Fragments vs. Number of Samples and the Number of Fragments vs. Threshold Percentage. The 
Number of Fragments vs. Number of Samples option displays a pair of gene signature curves, 
one for the present gene set and one for the absent gene set. This display is designed to give the 
user a visual sense of whether the sample set is large enough to generate a valid gene signature. 
The Number of Fragments vs. Threshold Percentage option displays the counts of the present 
and absent genes as a function of the threshold percentage. For example, if both thresholds were 
set to 90%, which means that qualified fragments should be present or absent in 3 1 out of 34 
samples, the number of fragments in the present and absent set would be approximately 4,000 
and 17,000 respectively. If the thresholds were set at 75% (less stringent) the sets grow to 7,944 
and 24,155 respectively. Detailed information about the gene firagments results are preferably 
displayed in the Gene Set Results. Fr example, to view a list of gene fragments in the present or 
absent gene set, a Gene Set Results window preferably presents a drop-down box to select either 
a vertical or horizontal split view of the results, a tab that displays the Present Gene Set results, a 
tab that displays the Absent Gene Set results, the number of genes in the Present or Absent Gene 
set, depending on which tab is selected, a statement about the type of normalization used, and a 
table of gene results in both the Present or Absent Gene Set view. 

In another preferred embodiment of the present invention, detailed information about 
selected gene firagments is displayed. The options preferably include Fragment Details, 
Attributes, Known Gene, Sample Details, Attributes, Experiments, Sample, Donor, and 
Sequence Cluster. Another aspect of the present invention is the ability to view gene fragments 
in a sequence cluster. The sequence cluster option presents a view of a gene fi^agment in the 
context of the Unigene cluster it is classified under. It is also possible to view a table with the 
expression values of all gene fi-agments in the same Unigene cluster over the corresponding 
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sample or sample set. 

The present invention also permits the display of data regarding specific fragments in 
combination with user-selected gene attributes. These attributes preferably include gene 
signature stats (present frequency, mean, median, standard deviation, expression and call values 
5 (one row per gene, where the present/absent calls and quantitative expression values for the 
fragment across all samples in the sample set is displayed), and expression and call values (one 
row per gene per sample, where one row per fragment per sample including the actual 
present/absent call and the quantitative expression value for the fragment). Another aspect of the 
present invention is a Pathway Viewer which presents a pathway display where expression 
Cio values are overlaid on known pathways. The proteins or enzymes that are encoded by genes are 
S3 highlighted with colored bands. Colors can represent the expression levels of the gene fragments, 

with more intense colors for extreme expression values (negative and positive). Clicking on a 
Q colored band can open a detail window that displays additional information about the expression 

yj 

P levels of the gene fragments encoding the enzyme or protein. When a detail window is open and 

U1 

a different gene fragment in the table is selected, a new set of proteins or enzymes is preferably 
highlighted (unless the fragment maps to the same set of nodes). If the fragment maps to more 
than one protein or enzyme, the application preferably selects one at random, scrolls it into view 
if necessary, and updates the detail window display. It is also possible to obtain a ftiU view of the 
pathway or to zoom into a particular area of a pathway. When a gene fragment is selected in the 
20 pathway table, all the nodes in the pathway that the fragment maps to are preferably 
"highlighted." 

The display of the pathway is provided in several formats, preferably including median 
values for the sample set (the median expression values are displayed for each fragment in the 
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selected gene set that overlaps the pathway, over all samples in the input sample set), mean 
values for the sample set (the mean expression levels are displayed for each fragment in the 
selected gene set that overlaps the pathway, over all samples in the input sample set), and raw 
expression values (the raw expression levels will be displayed for each fragment in the selected 
gene set that overlaps the pathway, over all samples in the input sample set). 

Another aspect of the present invention is a chromosome viewer which presents a display 
that renders expression values over a chromosome map. The chromosome diagram preferably 
displays a statement about the number of markers, and the number of matches displayed; that is, 
the total number of fragments on the chromosome, and the number from the current gene set; a 
statement about the display option; a table containing results data; a panel displaying the 
chromosome image, along with a vertical axis that displays the expression values. Li a preferred 
embodiment, to determine where a gene fragment maps on the chromosome, the gene fragment 
is selected from the table and in the chromosome diagram, the corresponding gene fragments 
will be indicated. There are preferred display options for the chromosome viewer. These include 
median values for sample set; mean values for sample set; raw expression values for samples; 
and present/absent call values for the samples. 

Another aspect of the invention is a gene mask option which provides a means of filtering 
the gene set, allowing for either intersecting gene sets to reveal shared genes, or to display 
differences between gene sets. For computing the gene signature analysis, fragments that have 
"marginal" calls for a particular sample are treated the same as "absent" fragments. Fragments 
that have "unknown" calls are ignored in the gene signature computation. If, for a particular 
fragment, p, m, and a are the numbers of samples for which the fragment was present, marginal, 
and absent, respectively, then the fractions p/(p+m+a)and(m+a)/(p+m+a) are computed; these 
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fractions are compared against the present and absent threshold percentages to determine if the 
fragment belongs to either of the gene signature gene sets. For example, suppose the gene 
expression data warehouse contained the present/absent/marginal/unknown call values shown in 
the table below, for the sample set S = {si, s2, s3, s4} and the genes {gl, g2, g3, g4, g5, g6, g7, 
g8, g9} . (In reality there would be data for thousands of genes, but only nine genes are shown for 
illustration.) At the bottom of the colunm for each gene are shown the percentages computed 
from the numbers of present, absent, and marginal calls for each gene across sample set S. 
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Suppose that the present and absent threshold percentages were both set to 75%. Then for 
this sample set, the gene signature operation returns a "present Gene Set" containing genes {gl, 
g2, g3, g4}, and an "absent Gene Set" containing {g5, g6, g7, g9}. The gene signature analysis 
also computes the mean, median, and standard deviation for each gene in the present and absent 
sets. The user can select any or all of these values to be displayed in the gene signature resuhs. 

The curves for the gene signature are computed by computing the present gene counts for 
each sample in the sample set; ordering the samples by present gene count in ascending order; 
initializing P to the set of present genes in the first sample (the height of the first point in the 
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curve is the number of genes in P); intersecting P with the set of present genes in the second 
sample, and repeating for each sample in the sample set. The heights of the successive points in 
the curve are the number of genes in P after each intersection step. The X axis component of 
each point is the index of the corresponding sample in the sorted sample set. This analysis is also 
performed for the absent genes, and the intersection set counts are plotted on separate graphs. 
The method used to produce the gene signature present and absent gene sets is not the same as 
the algorithm used to compute the gene signature curve. The gene signature computation utilizes 
a threshold percentage to obtain the Present/Absent Gene Sets, while the curve computation does 
not. 

Furthermore, U (unknown) and N (no expression data — that is, samples with missing 
chips) calls play a crucial role in producing discrepancies between the gene signature and 
the Gene Signature Curve. For example, consider the call value matrix below where the 



Si are samples and Gi are genes. 
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A gene signature computation to get the Present Gene Set with 100% threshold would 
yield the following Gene Set {Gl, G2, G3, G4}, with a count of four genes. The calculation 
algorithm does correct for partial chip sets and missing data by including only the samples for 
which there are expression data. Thus, all four genes are included in the Present Gene Set, even 
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though each of them is only called present in three out of the four samples. A gene signature 

curve, however, would yield the following data for the Present Gene Set. 

(Number of Samples. Number of Genes)= {(1, 3), (2. 2), (3,1), (4,0)} 
Number of Genes 4 - 

3- 

2- 

1- 



1 2 3 Number of Samples 
In the present invention, the "Number of Genes" values equal to zero are not 
plotted. Thus, the maximum number of samples shown on the x-axis may differ from the number 
of samples in the sample set, and may even differ between the present and absent gene signature 
Q.5 curves. The algorithm first orders the samples by the present count in ascending order, then 

i 

a 

^: 



initiaUzes P to the set of present genes in the first sample. The height of the first bar in the curve 
is the number of genes in P. P is then intersected with the set of present genes in the second 
sample, and the number of genes remaining in P is shown as the height of the second bar in the 



a 

n curve. This process is repeated for each sample in the sample set. The U (unknown) and N (no 

yi 

data for sample) calls play a crucial role in producing these "disparities." This example shows 
how the seeming disparities are produced by these two algorithms on the same data. Hence, one 
can obtain values where the last element in the histogram chart is not the same as the size of the 
gene set, as well as having the x-axis not equal to the size of the sample set. 

Another aspect of the present invention is a gene signature differential analysis which 
25 compares the results of two gene signatures created using the gene expression database of the 
present invention. Using these two gene signatures, the analysis computes four new sets of gene 
fi*agments. A gene signature differential analysis compares two gene signatures (which must 
have been previously computed and saved). The analysis derives four new sets of gene 
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fragments: those that are in both the first gene signature's present gene set and the second's 
absent gene set; those that are in both the first gene signature's absent gene set and the second's 
present gene set; those that are in both present gene sets; and those that are in both absent gene 
sets. 

After obtaining the gene signature differential analysis, the results can be presented in a 
number of preferred formats, including a summary view, a gene set results view, a pathways 
view, and a chromosome map view. Preferably the summary view contains the following 
information: the names of the two input gene signatures, when they were last modified, the size 
of the sample sets used, the thresholds used to compute the gene signatures, the sizes of their 
present and absent gene sets, a table summarizing the number of gene fi*agments in the four 
intersection sets: Present only in < 1st Gene Signature>, Present only in <2nd Gene Signature>, 
Present in Both (gene signatures), and Absent in Both (gene signatures), a history panel that 
records the date and time of the analysis and the version of the runtime engine used. The gene 
signature differential computes four new sets of fragments using the present and absent gene sets 
for two gene signatures. This is accomplished with the following sets: a set containing the 
fragments that are in the first gene signature's present set and the second's absent set; a set 
containing the fi-agments that are in the first gene signature's absent set and the second's present 
set; a set containing the fi-agments that are in both present sets; and a set containing the 
fragments that are in both absent sets. 

Another aspect of the present invention is a Fold Change Analysis which compares the 
mean expression levels of each gene firagment in a chipset between a control sample set and an 
experimental sample set to compute a fold change ratio. The Fold Change Analysis quantifies the 
change in expression for differentially expressed genes between pairs of sample sets. After 
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computing the fold changes for each fragment, the fragments are classified by fold change value. 

The results of the fold change analysis are preferably displayed as a summary of the 
number of genes in each fold change bracket and the direction of the fold changes between the 
control and experimental set(s). preferably, such a summary displays a Ust of all of the control 
sample sets and the number of samples in each; a Ust of all of the experimental samples and the 
number of samples they contain; a check box which the user may select to include in the gene 
counts fragments that were absent in both the experimental and control sample sets; a table 
listing the number of gene fragments with fold changes in the following ranges: • greater than 
100% between 10 and 100% between 5 and 10», between 4 and 5 between 3 and 4 % between 2 



gjlO and 3 between 1 and 2*, and with no change. 

The numbers are preferably broken down in the following maimer: the number of fold 



changes "up" in the experimental versus the control set; the nvmiber of fold changes "down" in 
the experimental versus the control set; and the total of all changes in the experimental versus 
control set. 

To obtain more specific data about the Fold Change Analysis results, the present 
invention preferably provides four different views of the results: filtering gene fragments, 
viewing gene fragments, viewing pathways, and viewing chromosome maps. 

The Filter Gene Fragments view allows for filtering the reported genes using a previously 
saved gene set. The user selects the gene set to use as a fiher; only genes contained in the filter 
20 will be displayed. 

The Gene Fragments view preferably presents a drop-down box in which to select either 
the vertical or horizontal split view; a statement of the number of gene fragments displayed; and 
a table of gene results. 
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The Pathway View presents a pathway display where expression values are overlaid on 
known pathways. 

The Chromosome View presents a display that renders expression values over a 
chromosome map. 

5 A fold change analysis operates on quantitative expression values. It computes, for each 

of a set of selected gene fragments, the ratio of the geometric means of the expression intensities 
in a control sample set and an experimental sample set. The fold change is equal to this ratio. If 
the ratio is less than one, and the user has elected to display fold changes with magnitudes and 
|«i du-ections, then the fold change magnitude is the reciprocal of the ratio, vsdth a "down" direction. 

a 

GiO Multiple fold change comparisons may be run in parallel, between different experimental sample 

4i 

C3 sets and matched control sample sets. The analysis categorizes gene fragments by the fold 

"1; change of their mean expression values between each pair of sample sets, and reports detailed 

P expression information for those fragments whose fold changes fall v^thin a user-specified 

23 range, or for fragments in a user-specified gene set. Confidence limits and p-values are also 
U1 

gj5 calculated when possible. The algorithm is based on a two-sided Welch modified two-sample t- 

W 

test. It assumes that the logarithms of the expression intensities for each sample set are normally 
distributed (which is a fairly good match to our data), and that the variance of each control 
sample set may differ from the variance of the experimental set it is being compared to. Note that 
the p-values are not corrected for multiple comparisons. The null hypothesis used for the t-test is 
20 that the population means for the logs of the expression values are the same in the two sample 
sets. The alternative hypothesis is that the means are different. The p-value reported is an 
estimate of the probability that a difference of means (and thus a fold change) as extreme as that 
observed could be obtained under the null hypothesis. Confidence limits on the fold change 
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value are calculated according to the same set of assumptions. By default, 95% confidence limits 
are computed; a different confidence level can be specified by the user. The upper and lower 
95% confidence limits reported are the estimated bounds of the interval for which, under the 
above assumptions, there is a 95% probability that the actual ratio of population means falls 
5 within the interval. Both sample sets must have more than one sample. If one or both of the 
sample sets has only one member, then confidence limits and p-values cannot be calculated, 
though a fold change is still reportable using the algorithm described below. Fold change is 
calculated on a per fragment basis: that is, the fold change algorithm is applied to each fragment 
separately. Users have the option to choose Gene Logic normalized, standard curve normalized, 
i«jO or Affymetrix normalized expression values for the analysis, but the same normalization must be 

h 

□ used across all samples and genes. A fioor is applied to the expression values with normalization 

M 

or scaling; the floor value used is based on a noise parameter Q, which depends on the type of 
^ normalization chosen. For Gene Logic normalized expression values ("GL expression"), each 
y chip has a standardized noise level Q equal to 10. More precisely, the distribution of the noise on 
1*45 each chip can be estimated as part of the normalization, and the expression values recalculated so 
that the standard deviation of GL expression values near 0 is equal to 10. 

For scaling expression values, the analysis uses the actual noise value Q = RawQ*SF 
calculated for each chip experiment by the Affymetrix software and stored in the GXDB 
database. The user also has the option to compute the fold change using only samples for each 
20 gene for which the gene is called present. When this option is selected, the numbers of samples 
Ux and Uy for each sample set will vary for different genes, and it may not be possible to compute 
p-values and confidence limits for every gene. The inputs to the algorithm are two sample sets, X 
and Y, and one gene set; along with the user-specified confidence level CL (between 0 and 
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100%, defaulting to 95%). 

The fold change algorithm is as follows. For sample set X and a gene fragment fin the 
gene set, do the following: 

1 . First apply a floor value to the expression data. Let en be the normalized 
expression value for fragment fin sample i. If normalization is used, set Cf. to max(efi, 20). If 
scaling is used, set Qn to max(efi, 2*SFfi *RawQfi) where RawQf, and SFa are the RawQ and scale 
factor parameters from the chip experiment on the chip containing fragment f, for sample i. If the 
resulting <20, set Qr to 20. If standard curve normalization is used, en, is left alone and no floor 
value is applied. 

2. Given expression levels {Cf,: i = 1, 2, n, } across nx samples in sample set X, 
calculate the logs: Xi= In(efi). 

3. Calculate the mean(x), i.e., mean(x) = (sum over i of xO/n^. 

4. Calculate the variance{x), i.e., var(x) = (sum over i of(Xi- mean(x))2 )/(n,-l). 

5. Repeat steps 1 - 4 for sample set Y. 

6. Calculate a t statistic: t=(mean(x) - mean(y))/s 
where s = sqrt( var(x)/n;,+var(y)/ny) 

7. The computation of the p-value and confidence limits requires the cumulative T 
probability distribution function Pt(t, DF) and the inverse function tInverse(p,DF). 
Compute the (non-integral) degrees of freedom parameter: 

DF = l/(cV(n,-l) + ((l -c)V(ny-l)) 
where c = var(x)/(nx*s^) 

8. Calculate the p-value by: Pval=Prob( | T | >t) = 2 *(1 -Pt(t,DF)) 

where Pt(t, DF) is the cumulative T distribution with DF degrees of freedom and t is the 
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statistic specified above. 

9. Compute the fold change ratio FC and upper and lower confidence limits. 

Given the user specified confidence level CL, compute: TI = s * tInverse((100+CL)/200, 

DF). The fold change and confidence limits are then calculated using: 
m = mean(x) - mean(y) FC = exp(m) 
Lower confidence limit = exp(m-TI) 
Upper confidence limit = exp(m+TI) 

The fold change direction is reported as "up" if FO 1 and "down" if FC < 1; the fold 
change magnitude is FC if FC> 1 and 1/FC if FC < 1. After computing the fold 
changes for each fragment between the control and experiment sample sets, the firagments are 
classified by fold change value, and a summary report is produced showing the counts of 
fragments with fold changes within certain ranges. Typically the user is interested in all gene 
fragments that have fold change magnitudes greater than a certain value. 

Fragments for which all samples in both sample sets return an absent call may be 
included in or excluded from the counts. Absent Gene Filtering Given control and experiment 
sample sets and a gene G, the fold change for G is computed as the ratio of the geometric means 
of the intensities for gene G over the two sample sets. 

If the user selects to use only samples where gene is present, then the intensities for the 
samples where G is called absent are excluded fi-om the geometric mean calculation; otherwise 
all intensities are included, hi both cases, a floor value is applied to the intensities, depending on 
the normalization selected. If normalization is used, the floor value is 20 (that is, all intensities 
less than 20 are replaced with 20 before calculating the geometric means). If scaling is selected, 
the floor value applied to the intensities from a particular chip experiment is twice the Q value 
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computed for that experiment (that is, a different floor value is used for each sample/chip pair). 

Confidence Level Confidence limits are calculated using a two-sided Welch modified t- 
test on the difference of the means of the logs of the intensities. The Welch form of the t-test is 
used because variances are generally unequal between the two groups of samples being 
5 compared. The logs of the intensities are assumed to come from a normal distribution, which 
matches our observations for the nonnegative values. The confidence bounds are no longer 
symmetric about the fold change estimate on an additive scale; however, they are symmetric 
about the fold change estimate on a multiplicative scale, which is the appropriate type of scale 
for ratios (such as fold changes). 
S3o Another aspect of the present invention is an Electronic Northern Analysis (E Northern) 



in 
a 



which takes a user-defined gene set and one or more sample sets as input and reports the range of 



□ 

expression levels for each gene fi-agment in the gene set across each sample set, for all of the 

« samples with user-specified present/absent calls. 

□ 

y J The range of expression values for a gene in an E Northem analysis is preferably reported 



IjIs as a pair of user-selected percentiles over the values for the samples in each sample set. By 



default, the values at the 25th and 75th percentiles over each sample set are shovm. The user may 
select different percentiles. For example, the user may choose to view the 0th percentile (the 
minimum expression value) and the 100th percentile (the maximum) for each sample set. In 
addition to the user-specified percentiles, the median expression value (the 50th percentile) is 
20 preferably reported. 

The electronic northem analysis is computed using one or more sample sets and a gene 
set. The gene set can be either a gene set that was created and saved previously or the resulting 
gene set of a gene signature differential. 
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The electronic northern analysis preferred display of the results includes a drop-down list 
in which to choose either a vertical or horizontal split view; the number of Affymetrix fragments; 
the number of rows; the upper and lower percentiles used; the normalization used; and the call 
types (present, absent or marginal) used to compute the percentiles. 

In another preferred embodiment of the present invention, the electronic northem analysis 
will preferably display detailed information about selected gene fragment, including fragment; 
attributes; known gene; sample details; experiments; sample; donor; sequence cluster; and £ 
Northem plot. 

The E Northem Plot displays a visual representation of Electronic Northem results and 
expression values for the selected Affymetrix fragment. The top part of the E Northem plot view 
displays selected attributes of the Affymetrix fragment. The plot shows tick marks or circles 
corresponding to the expression values for individual samples, overlaid with a translucent box 
plot in which the ends of the box represent the user-specified percentile values. The plot also 
displays multiple rows for a gene, one per input sample set; these are paired with bar graphs 
showing the percentage of samples in each sample set in which the gene is called present. 
Vertical bars are displayed at the median and at the median plus or minus 1 .5 times the 
interquartile range. The X axis of the plot shows graduated markers. 

An Electronic Northem Analysis (or E Northem) takes as input a user-defined gene set 
and one or more sample sets, and reports the range of expression levels for each Affymetrix gene 
fragment in the gene set across each sample set, over all the samples with user specified 
present/absent call values. The range is reported using percentile values, with the upper and 
lower percentile levels U and L specified by the user. If the user chooses U to be 100 and L to be 
0, the analysis reports the maximum and minimum expression values over the selected samples. 
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If the user chooses U = 75 and L = 25, the upper and lower quartile values are reported. The 
median value is reported as well. 

The E Northern is computed as follows for each sample set: 

1 . The user's selection in the E Northern Options dialog is used to determine how 
samples with Absent and Marginal calls will be used in the computations. If "Include Present 
calls only in computation" is selected, only samples with Present calls are used in the percentile 
and present score computations; Marginal calls are treated the same as Absent calls and are 
included in the absent score. If "Include Present and Marginal calls in computation" is selected, 
samples with either Present or Marginal calls are included in the percentile and present score 
computations. If "Include Present, Marginal, and Absent calls in computation" is selected, 
samples with Present, Marginal or Absent calls are used to compute the percentiles, and 
Marginal calls are included in the present score. 

2. For each gene fragment in the user-specified gene set, present and absent scores are 
computed by counting the numbers of Present and Absent calls for the samples in the given 
sample set, and dividing each count by the total number of samples that have expression data for 
the gene fragment. Samples with Unknown and Null calls are omitted and are not included in the 
total count of samples. The result is reported as a fraction in the tabular display (e.g., 17/22) and 
as a percentage in the E Northern plot. 

3. For each gene fragment, the percentile and median values are computed over 
the samples with user-selected call values. The expression values for these samples are first 
sorted in ascending order. This generates a rank order R for each expression value, R=l .. .N; 
where N is the number of selected samples. Define Xr as the expression value with rank order R. 

4. Three percentile values are computed: the 50th percentile (i.e., the median), and 
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the two user specified percentiles L and U. The Pth percentile of a set of values is the value X 
such that P percent of the values in the set are less than X. 

5. LetM=l+((P/100)*(N-l)). 

6. If M is an integer, the Pth percentile is X M , the expression value with rank order M. 
5 7. If M is not an integer, the Pth percentile is obtained by interpolating between the 

values X M and Xm+i. Let F be the fractional part of M, Then the Pth percentile is computed as X 
M + F*(Xmh-X„) 

8. The above calculation is performed for P = L, P = 50, and P = U. 

The present invention provides a system and method of analyzing gene expression, gene 
CJO annotation, and sample information in a relational format supporting efficient exploration and 

a 

^fl analysis, comprising: providing a data warehouse which comprises a gene expression database 
^t, for storing quantitative gene expression measurements for tissues and cell lines screened using 
various assays; a clinical database for storing information on bio-samples and donors; and a 

S3 

y fragment index for biological properties for DNA fragments; receiving a query regardmg gene 
□ 

Ijns expression of one or more DNA fi*agments; determining the level of gene expression of the one 
flJ or more DNA fragments; correlating the level of gene expression with the clinical database and 
the fragment index; and displaying the results of said correlation. 

An aspect of the present invention is a series of databases that contain gene expression data for 
tens of thousands of genes, measured over thousands of samples. The present invention provides tools 
20 for users to extract subsets of clinical and genetic data, perform analyses, and display the results. 

It will be appreciated that an aspect of the invention is the installation of the application. There 
are several aspects to installing the application, including system requirements, installation of the 
application; installation of the Java Runtime Environment; and downloading the installer. 
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With regard to system requirements, preferably the present invention requires a 500 MHz 
Pentium III processor running Windows NT 4.0 or later with at least 256 MB of RAM and virtual 
memory set to 256 MB; a color monitor with at least 1024 x 864 pixels and 256 colors (1 1 52 x 864 
pixels and 65536 colors are recommended); Netscape Navigator (version 4.7) or Internet Explorer 
(version 5.0 or later); a URL provided by the user for the invention's installation Web page; a workspace 
account; and a Java Runtime Environment (JRE), which may be downloaded from the invention's 
installation page. 

In addition, other commercially software packages are preferably available to augment the 
present invention, including Spotfire Pro (version 4.0 or later); Spotfire Array Explorer; Microsoft Excel 
2000; Eisen Cluster Tool; and GeneSpring; Partek Pro 2000. 

To install the appHcation of the present invention, a user preferably point his/her Web browser to 
the URL providing the home page of the present invention. The user can then select the download 
option, which opens the download and installation page of the present invention. Among other things, 
this page provides instructions for completing the two steps for installing the application of the present 
invention: installing the Java Runtime Environment and downloading the installer of the present 
invention. 

In a preferred embodiment of the present invention, the apphcation utilizes user profile 
information including full name, email, facsimile number, telephone number, and other contact 
information. 

Over time, users of the application of the present invention will develop a large number of 
sample sets, gene sets, and analysis results. The application of the present invention preferably 
incorporates a workspace which serves as a centralized repository for these data objects, organized into 
user-defined project folders. Access to the workspace is preferably controlled through user names, user 
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group affiliations, and passwords. User-defined data objects are by default private to the user; however, 
during the save process, the user preferably has the option of making data objects accessible to other 
users. 

The workspace window of the application of the present invention preferably contains the 
following components: a menu bar; quick access icons; a main window; and a status bar. 

The menu bar preferably contains the following menu items: a File tab; an edit tab; a Queries 
tab; an analyses tab; a view tab; a Window tab; and a Help tab. 

Under the File tab are preferably found several tabs, including an Open tab which opens a 
selected data object; a New Folder tab which creates a new project folder; a Properties tab which opens 
the Properties window; and an Exit tab which exits the application. 

Under the Edit tab are preferably found several tabs, including a Cut tab which cuts the selected 
object; a Copy tab which copies the selected object; a Paste tab which pastes the last cut or copied 
object; a Delete tab which deletes the selected object; a Rename tab which enables the renaming of the 
selected object; and a Set Permissions tab which opens the Permissions window where access 
permissions can be set for the selected object. 

Under the Queries tab are preferably found several tabs, including a Sample Set tab which 
displays a Sample Set window and a Gene Set tab which displays a Gene Query window. 

Under the Analyses tab are preferably found several tabs, including a Gene Signature tab which 
displays a Gene Signature Analysis window; a Gene Signature Differential tab which displays a Gene 
Signature Differential Analysis window; a Fold Change Analysis tab which displays a Fold Change 
Analysis window; an ENorthem tab which displays an Electronic Northern window; an Expression Data 
Tool tab which displays an Expression Data Tool window; and a Contrast Analysis tab which displays a 
Contrast Analysis window. 
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Under the View tab are preferably found several tabs, including a Toolbar tab which toggles the 
toolbar on and off; a Status Bar tab which toggles the status bar on and off; and a Workspace tab which 
enables a user to select various options for viewing including View All Folders which shows accessible 
folders and data objects for all users; My Folder which shows only the user's folder and data objects; 
5 Sample Sets which shows only folders and Sample Sets; Gene Sets which shows only folders and Gene 
Sets. The View tab preferably includes a Sort Table by Name tab which sorts the data objects by name, 
a Sort Table by Class which sorts the data objects by object type, and a Sort Table by Date which sorts 
the data objects by the date they were last modified. Under the View tab is also preferably found a My 
Profile tab which opens the User Profile window where password and contact information can be 

D 

piO updated. A ToolTip Customizer tab which opens the ToolTip Customizer window where settings for 

h 

P tooltip displays can be applied is also preferably found under the View tab. Under the View tab is also 
'\l preferably found a Refresh Selected tab which refreshes the display of a selected folder's contents and a 
Refresh All tab which refreshes all of the folders. 

Under the Windows tab are preferably found several tabs, including a Workspace tab which 

U1 

gJ5 brings the workspace window to the foreground; an Arrange All tab which makes all open windows 

m 

visible and arranges them on the desktop; a Minimize All tab which minimizes all but the workspace 
window; a Maximize All tab which maximizes all windows; and an <open windows> tab which lists the 
windows of the application that are currently open and allows one to select one of the items to bring that 
window to the foreground. 

20 Under Help tab are preferably found several tabs, including a Help tab which accesses the Help 

system; a Home Page tab which launches a new browser window, if one is not already open, and points 
to the application's Home Page; an Error Log tab which displays the error log; and an About tab which 
displays information about the version of the application of the present invention. 
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In another preferred embodiment of the present invention, quick access icons are preferably 
provided including a Sample Set icon which displays a new Sample Set query window and is used to 
select criteria and query the clinical database for a set of tissue, cell culture, or cell line samples; a Gene 
Set icon which displays a new Gene Query window and is used to select criteria and query the Fragment 
5 Index database for a set of gene fragments; 

a Gene Signature icon which displays a new Gene Signature Analysis window and is used to identify 
which genes are present and which are absent in a given sample set; a Gene Signature Differential icon 
which displays a new Gene Signature Differential Analysis window and is used to compare the gene 
|,& signature analyses of two given sample sets; a Fold Change icon which displays a new Fold Change 
S3lO Analysis window and is used to compute ratios of mean expression levels of genes between pairs of 
55 sample sets; an Electronic Northern icon which displays a new Electronic Northern Analysis window 

and is used to report and display graphically the range of expression levels for each gene fragment in a 
p gene set(s) across one or more sample sets; an Expression Data Tool icon which displays a new 
P Expression Data Tool window and is used to visualize expression data for the gene fragments in a gene 

m 

gj5 set(s) across one or more sample sets; and a Contrast Analysis icon which displays a new Contrast 
Analysis window and is used to find genes that fit a pattern of expression. 

Preferably the application of the present invention includes a Main Window consisting of two 
areas: a tree display showing the folders and objects in the workspace, with the user's folders on top, 
followed by the public folder, followed by the folders of other users, and a panel that shows detailed 
20 information about the objects in the currently selected folder, including their names, their class names 
(that is, the type of query or analysis), the chipsets used to create them, their owners, the date they were 
last modified, access permissions indicating which users can read (view) the object, and access 
permission indicating which users can write to (modify) the object. 
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Preferably the public folders of the application of the present invention include pre-defined gene 
and sample sets, including under Gene Sets By Chip - sets of all gene fragments for each chip type; 
Gene Sets By Chip Set - sets of all gene fragments for each chipset; Controls - all control gene 
fragments, grouped by chipset; Pathways- gene fragments for metabolic and signaling pathways, 
5 organized by chipset; and QC Controls - gene fragments used for RNA quality control, grouped by 
chipset. Under Sample Sets is preferably found Normal Mice - each sample set contains a particular 
strain of normal (that is, untreated) mice; Normal Rats - each sample set contains a particular strain of 
normal (that is, untreated) rats; and ToxExpress - contains sample sets for toxicology study groups and 
[.h pooled READS samples. 

□lO In a preferred embodiment of the appUcation of the present invention it is possible to view the 

0 properties of a data object: for example, the name of the object, the class of the object, the object path, 



the chipset used to create the object, a description of the object, and the access permissions for the 
object. 



a 

P Tooltip information is preferably displayed throughout the application by holding the mouse 

IJl .... 
51 5 cursor over certain features. If there is a tooltip associated with a feature, additional information about it 

is displayed in a textbox. Tooltips are especially helpfiil when viewing chromosome information. 

Preferably it is possible to customize the timing of the tooltip displays, or, in other words, to set the 

length of time the tooltip is displayed on the desktop. 

In a preferred embodiment of the present invention, the user can create a sample set. A sample 

20 set is a group of biological samples within the application containing gene expression data. A user can 

define sample sets by specifying a combination of query criteria that are applied to the chnical data in 

the database. Upon completion of the query, the application of the present invention displays a list of 

samples satisfying the criteria. 
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The application of the present invention contains data from gene chip experiments on a large 
variety of tissue, cell culture, and cell line samples, from humans, mice and rats. Hundreds of attributes 
are maintained for the samples, including donor characteristics, medical history, laboratory tests, and so 
on. Some attributes are stored for all samples; certain other sets of attributes are only maintained for 
5 specific species and sample types. For example, alcohol usage attributes are not stored for animal tissue, 
cell culture, and cell line samples. 

Gene chips are preferably grouped into sets of three to five chip types, each chipset containing 
probes for genes of a single species. Sample sets are constrained to only contain samples of a single 
species. In some cases, the expression database of the present invention contains data from more than 

a 

£;^0 one chipset for the same species. For this reason, sample sets are preferably subject to a further 
0 constraint: all samples in a sample set must have experiments in the database from a single chipset. The 
"1^ user must specify the chipset to be used to constrain the sample set by selecting it from the Chipset 
p menu prior to running the query. 

p Preferably there are several types of samples, including tissue, primary cell culture, and cell line. 

U1 

gJ5 It is possible for samples of different types to be mixed in a single sample set. However, in order to 

nj 

query against attributes that only apply to a specific sample type, the user must specify the type by 
selecting it from the Type menu before selecting any attributes. 

For example, Affymetrix periodically releases new gene chips for analyzing gene expression in 
tissues from various species; these are grouped in chipsets of 3 to 5 chips. It is possible that the database 
20 of the present invention contains a mixture of data derived from multiple chipsets per species. Although 
most of the gene fragments represented in a set may have counterparts in other sets, the oligos used to 
probe each fragment differ between the two sets. This means that gene sets may not contain a mixture of 
gene fragments from different chipsets; that sample queries are restricted by chipset as well as by 
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species; all samples in the sample set must have experiments from chips of the chipset that was selected 
when the query was run; that the chipset used to qualify the sample query will be saved as an attribute of 
the sample set; that analyses are restricted by the chipset associated with the sample sets that are input 
for the analysis; when multiple sample sets are input, sample sets must have all the same chipset 
attributes; and that the gene sets that are generated by the analysis will be filtered to contain only gene 
fragments for this chipset. 

To access the Sample Set query window, from the Queries menu select Sample Set, or click on 
the Sample Set icon in the workspace window. A Sample Set query window opens on the desktop: 

In a preferred embodiment of the present invention, the appHcation provides for a sample set 
query. In general, the sample set query allows the user to select sets of samples with specific 
characteristics. For example, a sample set of tissues can be selected that indicate fibrosis of the liver. A 
series of steps are involved in specifying the search parameters. These include: selecting the appropriate 
subset of the database to search. In this case, the chipset will be specified as "H.sapiens (HG_U95)," and 
the sample type will be specified as "tissue;" selecting the first attribute on which the query will be 
based. In this case, the organ is "liver;" selecting the second attribute on which the query will be based. 
In this case, the sample pathology/morphology will be "fibrosis;" selecting laboratory test attributes; 
selecting search options; selecting "sort by" options; and performing the search. 

It will be appreciated that the results can be viewed in a number of different formats. In one 
preferred format of the present invention, the results of the sample set query will automatically be 
displayed in a Results panel of the Sample Set window. This window presents the following 
information: a statement above the results indicating the parameters used in the search; a statement 
indicating the total number of samples found in the query, and the number currentiy selected; and a table 
of samples returned from the query. 
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Additionally, in a preferred embodiment, if the Sample Details option is selected in the View 
menu, a details panel will be displayed at the right of the window. This panel contains tabbed views that 
display detailed information about selected samples, including attributes, experiments, sample, and 
donor. 

hi a preferred embodiment of the present invention, the user can store and view information 
about when and how the sample set was created. This window contains the following: the date the 
sample set was created, the chipset used for the sample query the parameters that were used for the 
query, and any other relevant search criteria (for example, sort order). Preferably, this history is saved 
with the sample set. 

hi another preferred embodiment, as an alternate to an attribute-based sample query, a Genomics 
ID query mechanism is provided for creating a sample set from a list of known Genomics IDs. 

Another embodiment of the invention provides for importing by attribute. The Import by 
Attribute option allows for importing samples based on a list of values for a specific attribute. These 
attributes must have been previously saved in a user-created text file. The resuU of the import will be a 
list of all samples whose values for the specified attribute match any of the values in the file. 

Preferably the sample set can be saved to be reviewed at a later date or for use with the analyses. 
During the save process, the sample set is given a name and permissions can be set to limit who has 
access to the file. 

In another preferred embodiment it is possible to save the search parameters of a query without 
saving any data along with them. In this way, the query can be accessed for later use. Unlike sample sets 
and genes which are saved to the workspace, the query templates are saved on the local disk. Saved 
sample sets can be re-opened for further analysis. Once saved, the contents of the results do not change, 
even when more samples that satisfy the query are added to the database. In order to make the sample 
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set current, it is necessary to re-run the query. 

The Sample Set preferably offers a number of menu options. These include the following: a File, 
New Sample Set Window tab which opens a new Sample Set window; File, Open Sample Set tab which 
opens the Select Sample Set window from which to open a saved sample set; a File, Open Query 
5 Template tab which opens the Open Query Template window in which to open a saved query template; 
a File, Save Sample Set As tab which opens the Save Sample Set As window where the sample can be 
saved; a File, Save Query Template As tab which opens the Save Query Template As window where the 
query template can be saved; a File, Save Selected Samples tab which opens the Save Sample Set As 
window where selected samples can be saved as a unique set; a File, Import Sample Ids tab which opens 

□ 

fJO the Open window to import a list of genomics IDs from a previously saved text file; a File, Import by 

h 

D Attribute tab which opens the Import by Attribute window; a File, Export Sample Ids tab which opens 
4; the Save As window where a file in which to save the genomics IDs can be created; a File, Export tab 

lit) 

j«j which provides options for exporting the query results; a File, Invoke tab which provides options for 

fi accessing third-party applications in which to view the results; a File, Print tab which opens the Page 
Ol 

05 Setup window for setting up the page layout and printing the results; a File, Union with Sample Set tab 

ra 

which opens the Select Sample Set window where a previously saved sample set can be selected, any 
samples in the selected sample set that are not already in the current sample set will be appended to it; a 
File, Exclude Sample Set tab which opens the Select Sample Set window where a previously saved 
sample set can be selected, any of this new set's members that are in the current sample set will be 
20 removed, the resuU is the set difference between the two sample sets; a File, Intersect Sample Set tab 
which opens the Select Sample et window where a previously saved sample set can be selected, only the 
members that are common to both gene sets will be displayed; and a File, Close tab which closes the 
sample set window. 
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Also preferably included are a Edit, Select All tab which selects all of the samples in the query 
results; an Edit, Remove Selected Samples tab which deletes selected samples; an Edit, Copy Selected 
Samples tab which copies selected sample(s) to the clipboard; an Edit, Paste Samples tab which pastes 
copied sample(s) from the clipboard; a View, Sample Details tab which, if checked displays details in 
the Results panel; a View, Select Display Attributes tab which opens the Select Display Attributes 
window where the user can select columns to display in the results; a View, Automatically Include 
Condition Attributes in Results tab which, if checked, includes the parameters that defined the search in 
the default display columns; a View, Add Normalization Support Column tab which includes Affy 
Normalization which adds a column indicating whether or not Affymetrix normalization is supported, a 
Gene Logic Normalization which adds a column indicating whether or not Gene Logic normalization is 
supported, and a Standard Curve Normalization which adds a column indicating whether or not standard 
curve normalization is supported. 

The purpose of normaUzation is to allow for the comparison of the expression values reported 
from different gene chip experiments; therefore, if two different samples yield the same expression 
value for a gene fragment, there is reasonable confidence that the concentrations of mRNA transcripts 
for the fragment are the same in the two samples. Because of variations in the manufacturing process for 
the chips, as well as other factors, the unnormalized intensity values vary widely from one chip 
experiment to another for fragments with the same RNA concentration. There are many methods 
available to researchers to adjust for this variation. The application of the present invention preferably 
supports three of these methods; known as Affymetrix normalization. Gene Logic normalization, and 
standard curve normalization. 

Affymetrix normalization is the method supplied within the Affymetrix gene chip analysis 
software. The average differential intensity values (or "AveDiffs") produced by this software are the 
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result of this normalization process. The normalized values are computed by multiplying the 
unnormalized values by a scale factor. The scale factor is the same for all values in an experiment, and is 
calculated as follows: 

1 . From all the unnormalized AveDiff values in the experiment, delete the largest 2% and the 
5 smallest 2% of the values. That is, if the experiment yields 10,000 expression values, order the values 

and delete the smallest 200 and the largest 200. 

2. Compute the *trimmed mean," equal to the mean of the remaining values. 

3. Compute the scale factor SF = 100/(trimmed mean). 

Gene Logic normalization algorithm is based on the observation that the expression intensity 

□ 

Glo values from a single chip experiment have different distributions, dependmg on whether small or large 
W expression values are considered. Small values, which are assumed to be mostly noise, are 

approximately normally distributed with mean zero, while larger values roughly obey a log-normal 



distribution; that is, their logarithms are normally distributed with some nonzero mean. While 



p Affymetrix normahzation applies the same scale factor to all expression values in an experiment. Gene 

U1 

tls Logic normalization computes separate scale factors for "non-expressors" (small values) and 

ru 

"expressors" (large ones). The inputs to the algorithm are the Affymetrix-normalized AveDiff values, 
which are already scaled to set the trimmed mean equal to 100. The algorithm computes the standard 
deviation SD noise of the negative values, which are assumed to come from non-expressors. It then 
multiplies all negative values, as well as all positive values less than 2.0* SD noise,by a scale factor 
20 proportional to 1/ SD noise. Values greater than 2.0* SD noise are assumed to come from expressors. 
For these values, the standard deviation SD log(signal) of the logarithms is calculated. The logarithms 
are then multiplied by a scale factor proportional to 1/ SD log(signal) and exponentiated. The resulting 
values are then multiplied by another scale factor, chosen so there will be no discontinuity in the 
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normalized values from unsealed values on either side of 2.0* SD noise. 

Standard curve normalization attempts to relate the original expression intensity values from the chip 
experiments to actual mRNA concentrations for each gene expressed in the sample. In order to do this, 
known concentrations of particular gene fragments must be "spiked in" to the sample RNA mixture 
5 before hybridizing it to the chips. (Bacterial genes are used for the spike-ins, so there will not be any 
additional RNA contribution from the sample donor.) The chip experiment yields intensity 
measurements for the spike-in gene fragments. Ideally, the intensities will increase linearly with 
concentration; therefore, if intensity is plotted vs. concentration, it should be possible to draw a straight 
M line through the origin connecting the data points, and use its slope to infer the mRNA concentrations 
0[Q for the other gene fragments on the chip. In reality there are noise and non-linear effects which distort 
^5 this relationship; but one can still draw a straight line through the origin that is the best fit to the data 
j« points. The straight line is known as the "standard curve." 
Q This normalization procedure is as follows: 

P 1, Using identity link and gamma error, a generalized linear model is fit to the intensity versus 

□s concentration curve. A slope is determined, and appHed to the raw intensity values by dividing by the 

rj 

slope to get a concentration. Only data which are called present are used in the fit. 

2. These new concentration values for the spike-ins are entered into a logistic regression (with 
"A," "M," "U," or "N" called not present or 0, and "P" called present or 1) to determine a minimum 
sensitivity. The concentration corresponding to a logistic prediction of 0,7 is used as the sensitivity 

20 cutoff If the logistic regression fails, the sensitivity value is estimated via interpolation at .7 times the 
difference between the highest concentration called absent and the lowest concentration called present, 
added to the highest concentration called absent. 

3. The concentration values below 0 are reported as one half of the sensitivity cutoff. 
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4. Concentration values between 0 and the sensitivity value are reported as the average of the 
sensitivity cutoff and the raw value. 

The concentration value (in picomoles) is reported as the expression value, rather than the 

intensity. 

Standard curve normalization has the following implications for this version of the product: the 
Chipset options that are available for use will vary depending on the contents of the database the 
application has access to, including H.sapiens (Hu 42K), H.sapiens (HG_U95), M. musculus (Mul IK), 
M. musculus (Mul9K), M. musculus MG_U74), and R. norvegicus (RG_U34). 

Another preferred aspect of the application of the present invention is the creation of a gene set. 
A gene set is a list of DNA fragments for which probe sets are provided on one or more gene chips. 
Users define gene sets by specifying a combination of query criteria that are applied to the gene 
database. Upon completion of the query, the present invention displays a list of genes satisfying the 
criteria; the user can then select specific genes from this Hst or save the gene set for use with the 
analyses. 

Affymetrix fragments are the basic units for which the application of the present invention 
provides gene expression information. The present invention preferably does not provide access to the 
raw data for individual probes. Gene sets are created by performing a search of the gene index, the 
results of which can be saved for later use. The gene index is database of gene fragment annotations. 
Gene fragment annotations are obtained by linking the Affymetrix probe sets to UniGene clusters and, 
when possible, to known genes (found in NCBFs LocusLinks database), and dien to protein, enzyme, 
pathway, functional, and other databases. 

Affymetrix probe sets are tiled on gene chips that are species-specific (with the exception of the 
control probe sets). For example, the Human 42K chip set contains 42,000 probe sets based on 6,800 
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Human full-length mRNAs and 35K Human ESTs. 

A preferred aspect of the present invention is the ability to query the gene sets. For example, the 
database can be searched for gene fragments related to the fatty acid metabolic pathway. 

The first step in querying the gene set is to choose the appropriate subset of the gene index. The 
5 gene query enables a user to query the database for gene fragments of a particular species (that is, 

human, rat, or mouse). The next step is selecting the pathway. For this example, the metabolic pathway 
for fatty acids is used as the search parameter. The present invention preferably also allows for selecting 
search options, including: all of the following - when this option is selected, the search will be 
M performed for only those conditions that satisfy all conditions; for example, the pathway "fatty acid 
C^O metabolism" and the fragment type "_g (common groups);" any of the following - when this option is 
selected, the search will be performed for any of the search attributes selected, and results returned for 
^« any that are found. For example, results from both the pathway "fatty acid metabolism" and another 

□ parameter, such as fragment type "_g (common groups)" would be returned; and case sensitive- this 

W 

□ option applies to attributes where a text value is typed in. Li such cases, the capitalization of the results 
Cjs will exactly match what is entered, that is either lower or upper case. 

In this preferred embodiment of the present invention, the user can specify the sort order of the 

results. 

The results of the gene set query are preferably automatically displayed in the Results panel of 
the Gene Query window. This window preferably presents the following information: a statement above 
20 the results indicating the type of search performed, a statement indicating the total nimaber of genes 
found in the query, and the number currently selected, and a table of genes returned from the query. 

Preferably, if the Gene Details option is selected in the View menu, a details panel will be 
displayed. This panel contains tabbed views that display detailed information about selected results, 
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including attributes and known gene. 

Preferably the application of the present invention contains data for certain samples that have 
been run both on gene chips and on gels that provide restriction enzyme analysis of differentially 
expressed sequences (READS). The data from READS gels is preferably stored in a separate database. 
5 Preferably an ahemate way to create a gene set is to start with a nucleotide or protein sequence 

and search for Affymetrix fragments that match the sequence using BLAST. To distinguish the 
matching gene fragments in the results table for multiple BLASTs, an additional column, "Query 
Sequence," is preferably displayed, showing the tag for the sequence that matched the fragment. If more 
M than one query sequence matches the exemplar sequence of the same Affymetrix fragment, the one with 
QlO the smallest p-value will be displayed. Once a gene set is created from BLAST, it can be manipulated 
P and saved just like any other result. 

Another preferred aspect of the application of the present invention is the ability to import by 
attribute. Import by Attribute allows for importing Affymetrix fragments based on a list of values for a 

yj 

p specific attribute. These attributes must have been previously saved in a user-created text file. The result 

U1 

C35 of the import will be a list of all Affymetrix fragments whose values for the specified attribute match 
one of the values in the file. The GenBankID import is a special case where Affymetrix fragments can 
be imported according to the values of the Exemplar Seq: Accession attribute. 

The gene set preferably can be saved for later use or for use with the analyses. Saved gene sets 
can be re-opened for further analysis. Once saved, the contents of the results do not change, even when 
20 more genes that satisfy the query are added to the database. In order to make the gene set current, it is 
necessary to re-run the query. If the user wishes to retain the original results, save the new results under 
another name. 

It will be appreciated that there are a variety of menu options that are available for use with the 
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gene set query, including: a File, New Gene Set Window tab which opens a new Gene Query window; a 
File, Open Gene Set tab which opens the Select Gene Set window from which a previously saved gene 
set can be opened; a File, Open Query Template tab which opens the Open Query Template window 
from which a saved query template can be opened; a File, Save Gene Set As tab which opens the Save 
Gene Set As window in which the gene set can be saved; a File, Save Query Template As tab which 
opens the Save Query Template As window in which the query template can be saved; a File, Save 
Selected Genes tab which opens the Save Gene Set As window in which selected genes can be saved as 
a unique set; a File, Import Gene Ids tab which opens the Open window where it is possible to browse to 
find previously saved Affymetrix fragment name IDs to import; a File, Import by Attribute tab which 
opens the Import by Attribute window; a File, Export Gene Ids tab which opens the Save As window 
where a file can be created in which to save the gene Ids and which can then be used with other, third- 
party applications; a File, Export tab which provides options for exporting the results'; a File, Invoke tab 
which provides options for accessing third-party applications in which to view the results; a File, Print 
tab which opens the Page Setup window for setting up the page layout and printing the results; a File, 
Union with Gene Set tab which opens the Select Gene Set window in which a previously saved gene set 
can be selected, any genes in the selected set that are not already in the current set will be appended to it; 
a File, Exclude Gene Set tab which opens the Select Gene Set wmdow in which a previously saved gene 
set can be selected, any of this new set's members that are in the current gene set will be removed, the 
resuh is the set difference between the two gene sets; a File, Intersect Gene Set tab which opens the 
Select Gene Set window where a previously saved gene set can be selected, only the members that are 
common to both gene sets will display; and a File, Close tab which closes the gene set window. 

The gene set query preferably also includes an Edit, Select All tab which selects all of the results 
in the gene set; an Edit, Remove Selected Genes tab which removes selected genes from the gene set; an 
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Edit, Copy Selected Genes tab which copies selected gene(s) to the clipboard; an Edit, Paste Genes tab 
which pastes copied gene(s) from the clipboard. 

The gene set query preferably also includes a View Gene Details tab which, if checked, displays 
details in the results panel; a View, Select Display Attributes tab which opens the Select Display 
5 Attributes window in which columns for displaying the results can be selected; a View, Automatically 
Include Condition Attributes in Results tab which, if checked, includes the parameter(s) that defined the 
search in the default columns that are displayed; a View, Blast Output tab which exports the BLAST 
results to the default Web browser, where additional BLAST information (sequence alignment) can be 

^ viewed; and a View, Add READS Link Column tab. 

\1 

QO The gene set query preferably also includes the ability to select gene chips. The Chipset options 

□ that are available for use will vary depending on the contents of the database the application has access 

••I' to, including H.sapiens (Hu 42K), H.sapiens (HG_U95), M. musculus (Mul IK), M. musculus (Mul9K), 

P M. musculus (MG_U74), and R. norvegicus (RG_U34). 

w 

Another preferred embodiment of the application of the present invention is a gene signature 
□5 analysis of a sample set which extracts two sets of gene fragments from all of the gene fragments 

m 

represented in the sample set's chipset: those that are consistently expressed within the sample set, and 
those that are consistently not expressed. 

In order to perform the gene signature analysis, it is necessary to quantify the "consistency" of 
expression as two threshold percentages, one for the "present" set, the other for the "absent" set. 
20 Consistency of expression is a measure of how frequently a gene (Affymetrix fragment) is expressed, or 
not expressed, in a sample set. For example, if there are 5 samples in the sample set, and the user sets the 
present and absent threshold percentages to 80% and 80%, respectively, then the gene signature analysis 
computes one set of genes that are present in at least 4 out of 5 samples, and another set which are 
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absent in at least 4 of 5 samples. 

For computing the Gene Signature Analysis, Affymetrix fragments that have "marginal" calls for 
a particular sample are treated the same as "absent" fragments. Fragments that have "unknown" calls 
are ignored in the gene signature computation. If, for a particular Affymetrix fragment, p, m, and a are 
the numbers of samples for which the fragment was present, marginal, and absent, respectively, then the 
fractions p / (p + m + a) and (m + a) / (p + m + a) are computed; these fractions are compared against the 
present and absent threshold percentages to determine if the fragment belongs to either of the gene 
signature gene sets. 

For example, suppose the data warehouse of the present invention contained the 
present/absent/marginal/unknown call values shown in the table below, for the sample set S = {si, s2, 
s3, s4} and the genes {gl , g2, g3, g4, g5, g6, g7, g8, g9} . (Li reality there would be data for thousands of 
genes, but only nine genes are shown for illustration.) At the bottom of the column for each gene the 
percentages computed from the numbers of present, absent, and marginal calls for each gene across 
sample set S are shown. Suppose that the present and absent threshold percentages were both set to 
75%. Then for this sample set, the gene signature operation returns a "present Gene Set" containmg 
genes {gl, g2, g3, g4}, and an "absent Gene Set" containing {g5, g6, g7, g9}. 

The gene signature analysis also computes the mean, median, and standard deviation for each 
gene in the present and absent sets. The user can select any or all of these values to be displayed in the 
gene signature results. 

The curves for the gene signature are computed as follows: 

1 . Compute the present gene counts for each sample in the sample set. 

2. Order the samples by present gene count in ascending order. 

3. Initialize P to the set of present genes in the first sample. The height of the first point in the 
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curve is the number of genes in P. 

4, Intersect P with the set of present genes in the second sample, and repeat for each sample in 
the sample set. The heights of the successive points in the curve are the number of genes in P after each 
intersection step. The X axis component of each point is the index of the corresponding sample in the 

5 sorted sample set. 

5. Repeat steps 1 through 4 for the absent genes, and plot intersection set counts on separate 

graphs. 

In a preferred aspect of the present invention, the gene signature curve does not take into account 
the percentage thresholds specified. The gene signature curve works as a robustness test for the gene 
Ho signature. The purpose of the gene signature curve is to show that the Gene Signature operation had 
M enough samples to reach stability, that is, the count after intersecting does not change significantly. The 
method used to produce the gene signature present and absent gene sets is not the same as the algorithm 
P used to compute the gene signature curve. The gene signature computation utiHzes a threshold 

w 

Q percentage to obtain the Present/Absent Gene Sets, while the curve computation does not. Furthermore, 

yi 

□s U (unknown) and N (no expression data- that is, samples with missing chips) calls play a crucial role in 
producing discrepancies between the gene signature and the gene signature curve. 

Note that the calculation algorithm does correct for partial chip sets and missing data by 
including only the samples for which there are expression data. Thus, all genes are included in the 
Present Gene Set, even though each of them is only called present in a portion of the samples. 
20 In the present invention, the "Number of Genes" values equal to zero are NOT plotted. This is 

the reason that the maximum number of samples shown on the x-axis may differ fi-om the number of 
samples in the sample set, and may even differ between the present and absent gene signature curves. 
The algorithm first orders the samples by the present count in ascending order, then initiaUzes P to the 
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set of present genes in the first sample. The height of the first bar in the curve is the number of genes in 
P. P is then intersected with the set of present genes in the second sample, and the number of genes 
remaining in P is shown as the height of the second bar in the curve. This process is repeated for each 
sample in the sample set. The U (unknown) and N (no data for sample) calls play a crucial role in 
5 producing these "irregularities." This example shows how the seeming irregularities are produced by 
these two algorithms on the same data. Hence, values can be obtained where the last element in the 
histogram chart is not the same as the size of the gene set, as well as having the x-axis not equal to the 
size of the sample set. 

As an example of computing a gene signature, using a "Breast Cancer" sample set created 
51 0 previously, a gene signature can be computed where both the present and absent thresholds are set to 
75%. The Breast Cancer sample set was derived using the H.sapiens (HG_95U) chipset, the 

M 

i« Organ:Breast, and the Morphologyilnfiltrating Duct Carcinoma search parameters. 

p There are a variety of ways in which the result of the gene signature analysis can be displayed. 

yj 

P After the analysis is complete, the results are preferably displayed in the Summary tab of the Gene 

51 5 Signature Analysis window. This window presents the following information: a panel displaying the 

llj 

number of gene fi*agments in the Present Gene Set, a panel displaying the number of gene fragments in 
the Absent Gene Set, and the name of the sample set and the number of samples it contains. 

Preferred defauh summary columns which include the following: GenomicsID, Experiment(s), 
Total Present Calls, Total Absent Calls, Total Unknown Calls, Present Calls (Present Gene Set), 
20 Unknown Calls (Present Gene Set), Absent Calls (Absent Gene Set), and Unknown Calls (Absent Gene 
Set). 

Preferably, the Gene Signature History is displayed. This presents information about the 
thresholds used to compute the analysis, the date and time the analysis was performed, and the version 
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of the Runtime Engine (RTE) used for the analysis. 

Preferably, if the Show Details Panel option is selected in the View menu, a details panel will be 
displayed. This panel contains views that display detailed information about selected samples, including 
Sample Detail, Attributes, Experiments, Sample, and Donor. 
5 In a preferred aspect of the present invention, the gene signature curve tab provides several 

options, including: Number of Fragments vs. Number of Samples and Number of Fragments vs. 
Threshold Percentage. 

The Number of Fragments vs. Number of Samples option displays a pair of gene signature 
curves, one for the present gene set and one for the absent gene set. This display is designed to give the 

O 

gjo user a visual sense of whether the sample set is large enough to generate a valid gene signature. The 
□ number of samples in the gene signature curve may differ from the number of samples m the sample set. 

The Number of Fragments vs. Threshold Percentage option displays the counts of the present 



□ 



and absent genes as a function of the threshold percentage. For example, if both thresholds were set to 
90%, which means that qualified fragments should be present or absent in 76 out of 84 samples, the 



PS number of fragments in the present and absent set would be approximately 10,000 and 30,000 



respectively. If the thresholds were set at 75% (less stringent) the sets grow to approximately 13,000 and 
39,000 respectively. 

Detailed information about the gene fragment results are preferably displayed in the Gene Set 
Results tab. These include the Present Gene Set results, the Absent Gene Set results, the number of 
20 genes in the Present or Absent Gene set, depending on which tab is selected, a statement about the type 
of normalization used, and a table of gene results in both the Present Gene Set or Absent Gene Set view. 

Preferably, the present invention includes a Show Details option which, if selected, will display 
detailed information about selected gene fragments, including Affy Fragment Details, including 
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Attributes and Known Gene; Sample Details, including Attributes, Experiments, Sample, and Donor; 
Sequence Cluster; and Plot. 

The Sequence Cluster tab preferably presents a view of a gene fragment in the context of the 
UniGene cluster it is classified imder. By selecting a row in the main results window and then selecting 
this tab, it is possible to view a table with the expression values of all gene fi-agments in the same 
UniGene cluster over the corresponding sample or sample set. 

The Plot aspect of the present invention preferably displays a visual representation of expression 
values for the selected Affymetrix fragment. The plot shows lines or circles (depending on the user's 
preference) corresponding to the expression values for individual samples, overlaid with a translucent 
box plot in which the ends of the box represent the user-specified percentile values. 

The plot also displays muhiple rows for a gene, one per input sample set; these are paired with 
bar graphs showing the percentage of samples in each sample set in which the gene is called present. 
Vertical bars are displayed at the median, the lower quartile minus 1.5 times the interquartile range, and 
the upper quartile range plus 1.5 times the interquartile range. Assuming a normal distribution, the 
extreme bars are located approximately 3 standard deviations away from the median. Their locations are 
independent of the user-specified percentile values. The X axis of the plot shows graduated markers 
indicating expression intensity. 

A preferred aspect of the present invention is the ability to view pathways. The Pathway Viewer 
tab presents a pathway display where expression values are overlaid on known metabolic or enzymatic 
pathways. 

Another preferred aspect of the present invention is the ability to viewing chromosome maps. 
The Chromosome Viewer tab presents a display that renders expression values over a chromosome map. 
The chromosome diagram preferably provides a statement about the number of markers, and the number 
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of matches displayed; that is, the total number of Affymetrix fragments on the chromosome, and the 
number from the current gene set; a statement about the display option: "Mean" values were selected in 
the example; a table containing results data, which table can be manipulated just like other result tables; 
a panel displaying the chromosome image, along with a vertical axis that displays the expression values. 

In this preferred embodiment, the Median Values option displays Median Expression values for 
the sample set, mapped to Minus or Plus strand; the Mean Values option: displays Mean Expression 
values for the sample set, mapped to Minus or Plus strand; the Raw Expression Values option displays 
Expression Values for all Samples; and the Call Values option displays the Call Values for all Samples. 

Preferably it is possible to save any or all of the results as a unique gene set. This gene set can 
then be used with other analyses. 

In another preferred embodiment of the application of the present invention, a Set Gene Mask 
option permits filtering of the gene set. The gene mask allows for either intersecting gene sets to reveal 
shared genes, or for displaying the differences between gene sets. 

The results produced from the analyses preferably can be exported to a variety of third-party 
applications, including the Eisen Cluster Tool, GeneSpring, and Partek Pro 2000. 

Preferably there are a variety of menu options that are available for use with the gene signature 
analysis, including: a File, New Opens option which opens a new gene signature analysis window; a 
File, Open option which opens the Select Gene Signature window from which a saved gene signature 
can be opened; a File, Save Gene Signature option which opens the Save Gene Signature As window in 
which the gene signature can be saved; a File, Save Gene Set option which allows for saving the resuhs 
as a gene set; a File, Save Selected Genes option which opens the Save GeneSet As window in which 
selected gene fragments can be saved as a unique gene set; a File, Export option which provides options 
for exporting the results; a File, Invoke option which provides options for accessing third-party 
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applications in which to view the results; a File, Print option which opens the Page Setup window for 
setting up the page layout and printing the results; and a File, Close option which closes the Gene 
Signature Analysis window. 

Preferably the gene signature analysis also includes: a View, Compute Form option which 
accesses the Compute tab; a View Summary option which accesses the Summary tab; a View, GS Curve 
option which accesses the gene signature curve tab; a View, Gene Set Results option which accesses the 
Gene Set Results tab; a View, Pathway Viewer option which accesses the Pathway Viewer tab; a View, 
Chromosome Viewer option which accesses the Chromosome Viewer tab; a View, Show Details Panel 
option which, if checked, displays details in the Summary or Results panel; a View, Select Display 
Attributes option which opens the Select Display Attributes wmdow; a View, Gene Set Mask 
Add/Remove Mask option which opens the Add/Remove Gene Set Mask window in which to add or 
remove masks to gene sets; a View, Remove Selected Genes option which removes the selected genes 
from the currently displayed results; a View, Remove Unselected Genes option which removes the 
unselected genes from the results; a View, Reset to Original Gene Set(s) option which resets the results 
to their original state; a View, Sort By option which sorts the results; a View, Options option which 
opens the gene signature view options window for selecting viewing options; and a View, Plot Options 
option which opens the Plot Option window where display options for the plot can be selected. 

In another preferred embodiment of the present invention, the application can perform a gene 
signature differential analysis. A gene signature differential analysis compares the results of two sample 
sets. Using these two sample sets, the analysis computes two new sets of gene fragments. 

A gene signature differential analysis compares two sample sets (which must have been 
previously computed and saved). The analysis derives two new sets of gene fragments: those that are in 
both the first samples set's present gene set and the second's absent gene set and those that are in both 
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the first sample set's absent gene set and the second's present gene set. 

There are preferably several components of presentation of the results of the signature 
differential analysis, including the names of the two input sample sets, the size of the sample sets used, 
and the thresholds used to compute the gene signatures; a table summarizing the number of gene 
fragments in the two present sets: Present only in <Gene Set 1>, Present only in <Gene Set 2>; and a 
History panel that records the date and time of the analysis and the version of the runtime engine used. 

Detailed information about the gene fragment sets for the data the user has have selected are 
preferably displayed in the Gene Set Results tab. The information presented in this view preferably 
includes: a tab that displays gene sets that are Present only in <lst Gene Set>; a tab that displays gene 
sets that are Present only in <2nd Gene Set>; a tab that displays gene sets that are Present in both (gene 
sets); a tab that displays gene sets that are Absent m both (gene sets); a statement of the number of rows 
in the results and the type of normalization used; and a table of genes in the selected tab view. 

Preferably, if the Show Details Panel option is selected in the View menu, a details panel will be 
displayed. This panel contains views that display detailed information about selected samples, including 
Sample Detail, Attributes, Experiments, Sample, and Donor; Sequence Cluster, and Plot. 

Preferably one can further refine the data content of the Gene Set Results tab by selecting 
viewing options. These options include Show Affy Fragments only which, ff selected, user-specified 
attributes of qualified Affymetrix fi*agments will be displayed; Aggregate (per Sample Set) Values 
which, if selected, expression value statistics for each Affymetrix fragment will also be displayed; 
Expression and Call values (One Row per Gene) which, if selected, the results table displays one row 
per gene which contains the present/absent call and quantitative expression value for the fragment across 
all samples in the sample set; and Expression and Call values (One Row per Gene per Sample) which, if 
selected, the result table displays one row per firagment per sample including the actual present/absent 
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call and the quantitative expression value for the fragment. 

The application of the present invention also preferably includes the ability to viewing pathways. 
The Pathway Viewer tab presents a pathway display where expression values are overlaid on known 
pathways. 

5 One can further preferably refine the content that the Pathway Viewer tab displays by selecting 

viewing options, which include Median Values for Sample Sets which, if selected, the median 
expression levels will be displayed for each Affymetrix fragment in the selected gene set that overlaps 
the pathway, over all samples in the input sample sets; Mean Values for Sample Sets which, if selected, 
the mean expression levels will be displayed for each Affymetrix fragment in the selected gene set that 

C5 

g|0 overlaps the pathway, over all samples in the input sample sets; Raw Expression Values (Selected Affy 
^3 

P Fragments Only) which, if selected, the raw expression levels will be displayed for each Affymetrix 



4 
4 



fragment in the selected gene set that overlaps the pathway, over all samples in the input sample sets; 
!L and Raw Expression Values (All Affy Fragments in Pathway) which, if selected, the raw expression 

y levels will be displayed for all Affymetrix fragments that map to the pathway, regardless of the gene set 

Ul 

^15 selected, over all samples in the input sample sets. 

The application of the present invention also preferably includes the ability to viewing 
chromosome maps. The Chromosome Viewer tab presents a display that renders expression values over 
a chromosome map. 

One can further preferably refine the content that the Chromosome Viewer tab displays by 
20 selecting viewing options, which include Median Values for Sample Sets which, if selected, median 
expression values for each gene fragment across all samples in the gene signature sample sets will be 
displayed for the chromosome; Mean Values for Sample Sets which, if this option is selected, mean 
expression values for each gene fragment across all samples in the gene signature sample sets will be 
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displayed for the chromosome; Raw Expression Values for Samples which, if this option is selected, raw 
expression values for each gene for each sample in the selected sample sets will be displayed; and Call 
Values for Samples which, if this option is selected, call values will be displayed. 

The gene signature differential can preferably be saved for later use. It is also preferably 
5 possible to save any or all of the resulting set as a unique gene set. This gene set can then be used with 
other analyses. Various options are preferably included in saving a gene set, including Present Only in 
<"lst Gene Set">, Present Only in <"2nd Gene Set">, Present in both, and Absent in both. 

The gene signature differential menu options include a variety of menu options, including: a File, 
New tab which opens a new gene signature differential analysis window; a File, Open tab which opens 

g 

OiQ the Select GeneSigDiff window from which a previously saved gene signature differential can be 

R opened; a File, Save GS Differential tab which opens the Save GeneSigDiff As window where the gene 

r 

]|« signature differential can be saved; a File, Save Gene Sets tab which opens the Save Gene Set As 

□ window; a File, Save Selected Genes tab which opens the Save Gene Set As window in which gene 

W 

□ fragments selected in the table can be saved as a unique gene set; a File, Export tab which provides 
U1 

options for exporting the results; a File, Invoke tab which provides options for accessing third-party 
applications m which to view the results; a File, Print tab which opens the Page Setup window for 
setting up the page layout and printing the results; and a File, Close tab which closes the Gene Signature 
Differential Analysis window. 

The gene signature differential menu options preferably also include: a View, Compute Form tab 
20 which accesses the Compute tab; a View, Summary tab which accesses the Summary tab; a View, Gene 
Set Results tab which accesses the Gene Set Results tab; a Pathway Viewer tab which accesses the 
Pathway Viewer tab; a Chromosome Viewer tab which accesses the Chromosome Viewer tab; a Show 
Details Panel tab which, if checked, displays details in the Results panel; a View, Select Display 
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Attributes tab which opens the Select Display Attributes window; a View, Gene Set Mask Add/Remove 
Mask tab which opens the Add/Remove Gene Set Mask window in which to add or remove masks to 
gene sets; View, a Remove Selected Genes tab which removes the selected genes from the currently 
displayed results; a View, Remove Unselected Genes tab which removes the unselected genes from the 
results; a View, Reset to Original Gene Set(s) tab which resets the results to their original state; a View, 
Sort By Sorts tab which sorts the results; a View, Options tab which opens the Gene Signature 
Differential Options window for selecting viewing options; and a View, Plot Options tab which opens 
the Plot Option window where display options for the plot can be selected. 

The application of the present invention also preferably includes the ability to perform a fold 
change analysis. A Fold Change Analysis compares the mean expression levels of each gene fragment 
in a chipset between a control sample set and an experimental sample set to compute a fold change ratio. 
The Fold Change Analysis quantifies the change in expression for differentially expressed genes 
between pairs of sample sets. After computing the fold changes for each fragment, the fragments are 
classified by fold change value. 

A Fold Change Analysis operates on quantitative expression values. It computes, for each of a 
set of selected gene fragments, the ratio of the geometric means of the expression intensities in a control 
sample set and an experimental sample set. The fold change is equal to this ratio. If the ratio is less than 
one, and the user has elected to display fold changes with magnitudes and directions, then the fold 
change magnitude is the reciprocal of the ratio, with a "down" direction. Multiple fold change 
comparisons may be run in parallel between different experimental sample sets and matched control 
sample sets. The analysis categorizes gene fragments by the fold change of their mean expression 
values between each pair of sample sets, and reports detailed expression information for those fragments 
whose fold changes fall within a user-specified range, or for fragments in a user-specified gene set. 
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Confidence limits and p- values are also calculated when possible. The algorithm is based on a two-sided 
Welch modified two-sample t-test. It assumes that the logarithms of the expression intensities for each 
sample set are normally distributed, and that the variance of each control sample set may differ from the 
variance of the experimental set it is being compared to. 

Note that the p-values are not corrected for multiple comparisons. The null hypothesis used for 
the t-test is that the population means for the logs of the expression values are the same in the two 
sample sets. The alternative hypothesis is that the means are different. The p-value reported is an 
estimate of the probability that a difference of means (and thus a fold change) as extreme as that 
observed could be obtained under the null hypothesis. 

Confidence limits on the fold change value are calculated according to the same set of 
assumptions. By default, 95% confidence limits are computed; a different confidence level can be 
specified by the user. The upper and lower 95% confidence limits reported are the estimated bounds of 
the interval for which, under the above assumptions, there is a 95% probability that the actual ratio of 
population means falls within the interval. Both sample sets must have more than one sample. If one or 
both of the sample sets has only one member, then confidence limits and p-values cannot be calculated, 
though a fold change is still reportable using the algorithm described below. 

Fold change is calculated on a per fragment basis: that is, the fold change algorithm is applied to 
each fragment separately. Users preferably have the option to choose Gene Logic normalized, standard 
curve normalized, or Affymetrix normalized expression values for the analysis, but the same 
normalization must be used across all samples and genes. A floor is applied to the expression values 
with Gene Logic or Affymetrix normalization; the floor value used is based on a noise parameter Q, 
which depends on the type of normalization chosen. 

For Gene Logic normalized expression values ("GL expression"), each chip has a standardized 
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noise level Q equal to 10. More precisely, it estimates the distribution of the noise on each chip as part 
of the Gene Logic normalization, and recalculate the expression values so that the standard deviation of 
GL expression values near 0 is equal to 10. 

For Affymetrix normalized expression values, the analysis uses the actual noise value Q = 
RawQ*SF calculated for each chip experiment by the Affymetrix software and stored in the database. 

The user preferably also has the option to compute the fold change using only samples for each 
gene for which the gene is called present. When this option is selected, the numbers of samples nx and 
ny for each sample set will vary for different genes, and it may not be possible to compute p-values and 
confidence limits for every gene. The inputs to the algorithm are two sample sets (X and Y) and one 
gene set, along with the user-specified confidence level CL (between 0 and 100%, defaulting to 95%). 
Fold Change Algorithm 

For sample set X and a gene fi-agment fin the gene set, do the following: 

1. First apply a floor value to the expression data. Let Cf, be the normalized expression value for 
fragment f in sample i. 

If Gene Logic normalization is used, set en to max(efi ,20). 

If Affymetrix normalization is used, set qr to max(efi , 2*SFfi *RawQfi), where RawQfi and SFs 
are the RawQ and scale factor parameters from the chip experiment on the chip containing fragment f, 
for sample i. If the resulting Cf, <20,set Cf, to 20. 

If standard curve normalization is used, leave en alone; do not apply a floor value. 

2. Given expression levels {en: i = 1, 2, . .., Ux} across nx samples in sample set X, calculate the 
logs: Xi =ln(efi). 

3. Calculate the mean(x), i.e., mean(x) = (sum over i of Xi)/nx. 

4. Calculate the variance(x), i.e., var(x) = (sum over i of (Xi - mean(x))^ )/(nx - 1). 
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5. Repeat steps 1 - 4 for sample set Y. 

6. Calculate a t statistic: 
t=(mean(x) - mean(y)) / s 

where s = sqrt( var(x)/nx +var(y)/ny) 

7. The computation of the p-value and confidence limits requires the cumulative T probability 
distribution function Pt(t, DF) and the inverse function tlnverse(p, DF), Compute the (non-integral) 
degrees of freedom parameter: 

DF = 1 / ( c' /(nx -1) + ((1-c)' )/(% -1) ) 
Where c = var(x)/(nx *s ^) 

8. Calculate the p-value by: 
Pval=Prob(|T|>t)=2 *(1 -Pt(t,DF)) 

where Pt(t, DF) is the cumulative T distribution with DF degrees of fireedom and t is the statistic 
specified above. 

9. Compute the fold change ratio FC and upper and lower confidence limits. Given the user 
specified confidence level CL, compute: 

TI = s * tInverse((100+CL)/200, DF) 

Now the fold change and confidence limits are calculated using: 
m = mean(x)-mean(y) 
FC = exp(m) 

Lower confidence limit = exp(m-TI) 
Upper confidence limit = exp(m+TI) 

The fold change direction is reported as "up" if FC> 1 and "down" if FC < 1; the fold change 
magnitude is FC if FC > 1 and 1/FC if FC < 1. 
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After computing the fold changes for each fragment between the control and experiment sample 
sets, the fragments are classified by fold change value, and a summary report is produced showing the 
counts of fragments with fold changes within certain ranges. Typically the user is interested in all gene 
fragments that have fold change magnitudes greater than a certain value. Fragments for which all 
5 samples in both sample sets return an absent call may be included in or excluded from the counts. 

Given control and experiment sample sets and a gene G, the fold change for G is computed as 
the ratio of the geometric means of the intensities for gene G over the two sample sets. If the user selects 
the toggle "Use only samples where gene is present," then the intensities for the samples where G is 

M called absent are excluded from the geometric mean calculation; otherwise all intensities are included. 

□ 

C40 In both cases, a floor value is appUed to the intensities, depending on the normalization selected. If 

P "Gene Logic" normalization is used, the floor value is 20 (that is, all intensities less than 20 are replaced 

^« with 20 before calculating the geometric means). If "Affy" normalization is selected, the floor value 

□ applied to the intensities from a particular chip experiment is twice the Q value computed for that 

P experiment (that is, a different floor value is used for each sample/chip pair). 

U1 

GI5 Confidence limits are calculated using a two-sided Welch modified t-test on the difference of the 

means of the logs of the intensities. The Welch form of the t-test is used because variances are generally 
unequal between the two groups of samples being compared. The logs of the intensities are assumed to 
come from a normal distribution. The confidence bounds are no longer symmetric about the fold change 
estimate on an additive scale; however, they are symmetric about the fold change estimate on a 
20 multiplicative scale, which is the appropriate type of scale for ratios (such as fold changes). 

Preferably, the results of the fold change analysis can be displayed in a summary which presents 
a summary of the number of genes in each fold change bracket and the direction of the fold changes 
between the control and experimental set(s). It preferably displays the following information: a list of all 
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of the control sample sets and the number of samples in each; a Ust of all of the experimental samples 
and the number of samples they contain; a check box which the user may select to include in the gene 
counts fragments that were absent in both the experimental and control sample sets; a table listing the 
number of gene fragments with fold changes in the following ranges: greater than 100; between 10 and 
100; between 5 and 10; between 4 and 5; between 3 and 4; between 2 and 3; between 1 and 2; and with 
no change. 

The numbers are preferably broken down in the following manner: the number of fold changes 
"up" in the experimental versus the control set; the number of fold changes "down" in the experimental 
versus the control set; and the total of all changes in the experimental versus control set. 

Preferably the user can obtain more specific data about the fold change analysis results, 
including filtering gene fragments, viewing the results, viewing pathways, and viewing chromosome 
maps. 

The Filtering Gene Fragments option allows for filtering the reported genes using a previously 
saved gene set. 

The data content of the Gene Fragments (or, in other words, the Gene Set Results) can preferably 
further be refined by selecting viewing options, including magnitude and direction which displays the 
fold changes and the confidence, with values <1 changed to their reciprocals, along with extra columns 
showing the direction of the change (up or down); ratio (<1.0 if downward) which displays all fold 
changes and confidence limits as ratios; Show Raw Expression and Call Values which, if selected, 
quantitative expression values and present/absent calls are displayed, for each gene fragment and 
sample; and Show Mean, SD for Each Sample Set which, if selected, means, medians, and standard 
deviations for each sample set will be displayed. 

The application of the present invention also preferably includes the ability to view pathways 
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with regard to selected gene fragments. The Pathway View tab presents a pathway display where 
expression values are overlaid on known pathways. The content that the Pathway View tab displays can 
be refined further by selecting viewing options, including Fold Changes for Sample Sets which, if 
selected, the fold change values for each Affymetrix fragment in the selected gene set that overlaps the 
5 pathway will be displayed; Mean Values for Sample Sets which, if selected, the mean expression levels 
will be displayed for each Affymetrix fragment over all samples in each input sample set; Median 
Values for Sample Sets which, if selected, the median expression levels will be displayed for each 
Affymetrix fragment over all samples in each input sample set; Raw Expression Values for Samples 
which, if selected, the raw expression levels will be displayed for each selected Affymetrix fragment; 

q 

Clo All Affy Fragments in Pathway which, if selected, all gene fragments which overlap the pathway will be 
f 

p displayed; and Selected Affy Fragments Only which, if selected, only gene fragments selected in the 

J"* 

Filter Gene Fragments panel will be displayed. 

P The application of the present invention also preferably includes the ability to view chromosome 

U 

P maps which present a display that renders expression values over a chromosome map. The content that 

ijl 

5J5 the Chromosome View tab displays can be further refined by selecting viewing options, including Fold 
Changes which, if is selected, fold change values will be displayed; Median Values which, if selected, 
median values will be displayed; Mean Values which, if selected, mean values will be displayed; Raw 
Expression Values for Samples which, if this option is selected, raw expression values will be displayed; 
and Call Values for Samples which, if selected, call values will be displayed 
20 The fold change analysis preferably can be saved for fiiture use. 

Preferably there are a variety of menu options that are available for use with the fold change 
analysis, including a File, New tab which opens a new Fold Change Analysis window; a File, Open tab 
which opens the Select Fold Change MultiSet window fix)m which a previously saved fold change can 
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be opened; a File, Save Fold Change tab which opens the Save Fold Change MultiSet As window in 
which to save the fold change; File, Save Gene Set tab which opens the Save Gene Set As window 
where the result gene set can be saved; a File, Save Selected Genes tab which opens the Save Gene Set 
As window where selected gene fragments can be saved as a unique gene set; a File, Export tab which 
5 provides options for exporting the results; a File, Invoke tab which provides options for accessing third- 
party applications in which to view the resuUs; a File, Print tab which opens the Page Setup window for 
setting up the page layout and printing the results; and a File, Close tab which closes the Fold Change 
Analysis window. 

Preferably the fold change analysis menu also includes a View, Gene or Sample Details tab 

Q 

CJO which, if selected, displays the details of a selected gene fragment or sample; a View, Select Display 
p Attributes tab which opens the Select Display Attributes window; a View, Add READS Link Column 

'1^ tab which opens the Select Study window; a View, Gene Set Mask Add/Remove Mask tab which opens 

}i 

P the Add/Remove Gene Set Mask window in which to add or remove a gene set mask to the results; a 

U 

p View, Remove Selected Genes tab which removes the selected genes from the currently selected results; 

iJl 

ps a View, Remove Unselected Genes tab which removes the unselected genes from the results; a View, 

nj 

Reset to Original Gene Set(s) tab which resets the results to their original state; a View, Sort By tab 
which sorts the resuhs; a View, Options tab which opens the Fold Change View Options window for 
selecting viewing options; and a View, Plot Options tab which opens the Plot Option window where 
display options for the plot can be selected. 
20 In another preferred embodiment of the present invention, the application can perform an 

Electronic Northern Analysis. An Electronic Northern Analysis (ENorthem) takes a user-defined gene 
set and one or more sample sets as input. The range of expression levels is reported for each gene 
fragment in the gene set across each sample set, for all of the samples with user-specified present/absent 
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calls. The range of expression values for a gene in an ENorthem analysis is reported as a pair of user- 
selected percentiles over the values for the samples in each sample set. By default, the values at the 25th 
and 75th percentiles over each sample set are shown. The user may select different percentiles. For 
example, the user may choose to view the 0th percentile (the minimum expression value) and the 100th 
5 percentile (the maximum) for each sample set. In addition to the user-specified percentiles, the median 
expression value (the 50th percentile) is always reported. 

An Electronic Northern Analysis (or E Northern) takes as input a user-defined gene set and one 
or more sample sets, and reports the range of expression levels for each Affymetrix gene fragment in the 

|«s. gene set across each sample set, over all the samples with user specified present/absent call values. The 

P 

Qo range is reported using percentile values, with the upper and lower percentile levels U and L specified 
MS 

0 by the user. If the user chooses U to be 100 and L to be 0, the analysis reports the maximum and 

minimum expression values over the selected samples. If the user chooses U = 75 and L = 25, the upper 

P and lower quartile values are reported. The median value is reported as well. 

W 

p The E Northern is computed as follows for each sample set: 

til 

□5 1 . The user's selection in the E Northern Options dialog is used to determine how samples with 

absent and marginal calls will be used in the computations. If "Include Present calls only in 
computation" is selected, only samples with present calls are used in the percentile and present score 
computations; marginal calls are treated the same as absent calls and are included in the absent score. If 
"Include Present and Marginal calls in computation" is selected, samples with either present or marginal 
20 calls are included in the percentile and present score computations. If "Include Present, Marginal, and 
Absent calls in computation" is selected, samples with present, marginal or absent calls are used to 
compute the percentiles, and marginal calls are included in the present score. 

2. For each gene fragment in the user-specified gene set, present and absent scores are computed 
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by counting the numbers of Present and Absent calls for the samples in the given sample set, and 
dividing each count by the total number of samples that have expression data for the gene fragment. 
Samples with Unknown and Null calls are omitted and are not included in the total count of samples. 
The result is reported as a fraction in the tabular display (e.g., 17/22) and as a percentage in the E 
5 Northern plot. 

3. For each gene fragment, the percentile and median values are computed over the samples with 
user-selected call values. The expression values for these samples are first sorted in ascending order. 
This generates a rank order R for each expression value, R=l . . .N; where N is the number of selected 

M samples. Define X R as the expression value with rank order R. 

P 

^0 4. Three percentile values are computed: the 50th percentile (i.e., the median), and the two user 

n 

specified percentiles L and U. Recall that the Pth percentile of a set of values is the value X such that P 
, j» percent of the values in the set are less than X. 
□ 5. Let M = 1 + ((P/100)*(N-1)). 

P 6. If M is an integer, the Pth percentile is X M, the expression value with rank order M. 

yi 

SI5 In this case, the plot will return the expression values which are one rank higher than what the table 

nJ 

returns for the upper and lower percentiles. The data in the table is more accurate than the plot. 

7. If M is not an integer, the Pth percentile is obtained by interpolating between the values X M 
and X M+1. Let F be the fractional part of M. Then the Pth percentile is computed as 

XM+F*(XM+1 -XM) 
20 8. The above calculation is performed for P = L, P = 50, and P = U. 

The ENorthem analysis is preferably computed using one or more sample sets and one or more 
gene sets. The gene set(s) can be either an existing gene for a gene set defined by using a gene signature 
differential. 
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Detailed information about the gene fragments in the E Northern results is preferably displayed 
in the Results tab. Preferably, this information includes a statement of the following: the number of 
rows, the upper and lower percentiles used, the normalization used, and the call types (present, absent or 
marginal) used to compute the percentiles; and a table of genes. 
5 Preferably the ENorthem provides a Show Details Panel which, if selected, displays detailed 

information about selected gene fragment, including Affy Fragment, which includes Attributes and 
Known Gene data; Sample Details, which include Attributes, Experiments, Sample, and Donor data; 
Sequence Cluster; and Plot. 
1^6 Preferably, the data content of the Results can be further refined by selecting viewing options, 

G3o including Include Present calls only in computation, which, if selected, the percentiles are computed 

23 using expression values that are associated only with Present calls; Liclude Present and Marginal calls in 

J** 

computation, which, if selected, the percentiles are computed using expression values that are associated 

P with Present and Marginal calls; and Include Present, Marginal, and Absent calls in computation, which, 

W 

p if selected, the percentiles are computed using expression values that are associated with Present, 

lii 

□ S Marginal, and Absent calls. 

The E Northern Analysis can preferably be saved for later use. 

Preferably there are a variety of menu options that are available for use with the E Northern 
analysis, including a File, New tab which opens a new Electronic Northern Analysis window; a File, 
Open tab which opens the Select ENorthem window from which a previously saved E Northern analysis 
20 can be opened; a File, Save ENorthem tab which opens the Save ENorthem As window where the E 
Northem analysis can be saved; a File, Save Gene Set tab which opens the Save Gene Set As window in 
which the gene set used for the E Northem can be saved; a File, Save Selected Genes tab which opens 
the Save Gene Set As window in which selected gene fragments can be saved as a unique gene set; a 
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File, Export tab which provides options for exporting the results; a File, Invoke tab which provides 
options for accessing third-party applications in which to view the results; a File, Print tab which opens 
the Page Setup window for setting up the page layout and printing the results; and a File, Close tab 
which closes the Electronic Northern window. 

The menu options that are available for use with the E Northern analysis preferably also includes 
a View, Compute Form tab which accesses the Compute tab; a View, Results tab which accesses the 
Results tab; a View, Show Details Panel tab which, if checked, displays details in the Results view; a 
View, Select Display Attributes tab which opens the Select Display Attributes window where columns 
to display in the results can be selected; a View, Sort By tab which sorts the results; a View, Options tab 
which opens the Electronic Northern Options window for selecting viewing options; and a View, Plot 
Options tab which opens the Plot Option window where display options for the plot can be selected. 

In another preferred embodiment of the present invention, the application further comprises an 
Expression Data Tool, which allows the user to retrieve and display expression data values (individual 
or aggregate) for one or more sample sets and one or more gene sets. The expression values preferably 
can be displayed in a table or overlaying a pathway or chromosome map. 

The Expression Data Tool identifies gene expression data for genes and sample sets of interest, 
and extracts the individual (raw), mean, or median expression values for them (including the quantitative 
expression intensity and present/absent calls). The resulting data can either be displayed within the 
application of the present invention or exported to be used with analyses outside of the application. 

The results for the selected samples are preferably displayed in the Expression Data tab, which 
preferably presents a statement of the number of rows in the results, a statement about the type of 
normalization used, and a table of result genes. 

Preferably the Expression Data Tool provides a Show Details Panel which, if selected, displays 
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detailed information about selected gene fragment, including Affy Fragment, which includes Attributes 
and Known Gene data; Sample Details, which include Attributes, Experiments, Sample, and Donor data; 
Sequence Cluster; and Plot. 

The data content of the Expression Data can preferably be further refined by selecting additional 
options, including Aggregate Values (Sample Set) and Individual Sample(s). 

The application of the present invention also preferably includes the ability to view pathways 
with regard to Expression Data Tool. The Pathway Viewer tab presents a pathway display where 
expression values are overlaid on known pathways. The content that the Pathway Viewer tab displays 
can be further refined by selecting viewing options, including Raw Expression Values (Selected Affy 
Fragments Only) which, if selected, the raw expression levels will be displayed for each Affymetrix 
fiagment in the selected gene set that overlaps the pathway, over all samples in the input sample set(s), 
and Raw Expression Values (All Affy Fragments in Pathway) which, if selected, the raw expression 
levels will be displayed for all Affymetrix fragments that map to the pathway, regardless of the gene set 
selected, over all samples in the input sample set(s). 

The application of the present invention also preferably includes the abihty to view chromosome 
maps with regard to Expression Data Tool. The Chromosome Viewer tab presents a display that renders 
expression values over a chromosome map. The content that the Chromosome Viewer tab displays can 
be further refmed by selecting viewing options, including Raw Expression Values for Samples which, if 
selected, raw expression values for all the samples will be displayed, and Call Values for Samples 
which, if selected, call values for all the samples will be displayed. 

A gene set or selected genes can preferably be saved to use with other analyses. 

Preferably there are a variety of menu options that are available for use with the Expression Data 
Tool, including a File, New tab which opens a new Expression Data Tool window; a File, Save Gene 
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Sets tab which opens the Save Gene Set As window in which a gene set of the resuhs can be saved; a 
File, Save Selected Genes tab which opens the Save Gene Set As window in which selected gene 
fragments can be saved as a unique gene set; a File, Export tab which provides options for exporting the 
results; a File, Invoke tab which provides options for accessing third-party applications in which to view 
5 the results; a File, Print tab which opens the Page Setup window for setting up the page layout and 
printing the results; and a File, Close tab which closes the Expression Data Tool window. 

Preferably the Expression Data Tool menu further includes a View, Parameters tab which 
accesses the Parameters tab; a View, Expression Data tab which accesses the Expression Data tab; a 
View, Pathway Viewer tab which accesses the Pathway Viewer tab; a View, Chromosome Viewer tab 

Clo which accesses the Chromosome Viewer tab; a Show Details Panel tab which, if selected, displays the 

f 

P details in the Expression Data panel; a View, Select Display Attributes tab which opens the Select 

1« Display Attributes window where columns to display in the results can be selected; a View, Gene Set 

p Mask Add/Remove Mask tab which opens the Add/Remove Gene Set Mask window in which to add or 

w 

p remove a gene set mask to the results; a View, Remove Selected Genes tab which removes the selected 
CJ5 genes from the currently selected results; a View, Remove Unselected Genes tab which removes the 

m 

unselected genes firom the results; a View, Reset to Original Gene Set(s) tab which resets the results to 
their original state; a View, Sort By tab which sorts the results; a View, Options tab which opens the 
Expression Data Tool Options window for selecting viewing options; and a Plot Options tab which 
opens the Plot Option window where display options for the plot can be selected. 
20 In another preferred embodiment of the present invention, the application further provides the 

ability to perform a Contrast Analysis, which is a "pattern matching" tool used to find genes that fit a 
pattern of expression across sample sets. 

Contrast analysis generalizes the significance testing performed in the fold change analysis tool 
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to test for patterns of expression involving two or more sample sets. The specific statistical method is an 
ANOVA model with expression values used as response variable and sample sets used to define group 
effects. Contrasts are used to specify pattems among group effects. If the sample sets are labeled A, B, 
and C, for example, the contrast weight vector {1, -2, 1 } specifies a null hypothesis of the form: 
5 H(0): 1 X mean S2A (log Es) -2 x mean SSB (log ES) +1 x mean SEC (log ES) = 0 

where ES is the expression level of the gene being tested for samples. 

(As is the case with the fold change analysis, the test is performed on the logarithm of the 
expression values, not on the expression values directly. This is done to increase the statistical power of 
the method. Negative expression values are mapped to negative log values by taking the log of the 
I" JO absolute value and multiplying by -1 . Expression values whose absolute values are less than 1 are 

i 

□ replaced by 0.) 

«|- The null hypothesis is used to calculate a t-statistic for each pattern in a method similar to the 

^ familiar two-sample t-test. The value of the t-statistic increases according to the adherence to the pattern 
y of the expression values of the gene over the samples in the sample sets. Large positive t-scores mean 
that the pattern of variation of expression values between sample sets, relative to the amount of variation 

Pi 

within sample sets, closely follows the pattern represented by the contrast. Large negative t-scores mean 
that the pattern of variation is the inverse of the pattem represented by the contrast. This would happen, 
for instance, for the contrast {-1, 1} (representing an increase of expression in Sample Set 2 relative to 
Sample Set 1), for genes whose expression was decreased in Sample Set 2. Finally, t-scores close to zero 
20 mean that the gene's expression pattem matches neither the contrast pattem nor its inverse, or that the 
amount of variation between sample sets is comparable to or smaller than the variation within sample 
sets. 

Multiple contrasts can be tested in parallel, in order to rank genes according to how well they fit 
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any of several patterns. The user has the option of ranking the genes by either the maximum t-score 
(corresponding to selecting genes by the best fit to a single pattern) or the minimum t-score 
(corresponding to selecting genes by their ability to fit all of the patterns). 

The contrasts can be specified either by using a graphical tool or by directly entering the contrast 
5 weights expert users famihar with the method). Due to the mathematical constraints of the model, some 
patterns specified by the graphical tool may lead to unexpected results. 

As described below, in these cases a warning will be issued at the time the pattern is specified, 
and the user is encouraged to examine the output of the analysis carefully to make sure the result 

j,6 generated corresponds to what he/she is looking for. 

P 

GJO If requested, a p-value is estimated by a randomization trial over sample assignments to sample 

Hi? 

P sets to assess the significance of the maximum t-score over all the genes and patterns requested. 

*!« The "Leave One Out Plot" is a tool for detecting outlier samples. It allows the user to identify 

l«j samples that behave so differently from the other members of their sample sets that they have a 

Si 

p disproportionate effect on the results of the contrast analysis. These samples can be analyzed further 
U1 

535 with other tools to determine if there are problems with the sample data quality. 

Hi 

The contrast analysis is a generalization of the fold change analysis, and operates on multiple 
groups of sample sets, performing a similar series of fits for each group and comparing their levels using 
a set of contrasts specified by the user. Once these group effects are calculated, the results are multiplied 
by the contrasts, and a new statistic is calculated, which is similar in form and meaning to the two- 
20 sample t statistic. 

Contrast Analysis can be seen as an extension of fold change analysis. The fold change tool used 
to compare expression levels between two experimental conditions, or groups. This tool computes t- 
scores (not exposed to the user) that can be used to rank the strength of the difference between 
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conditions for an individual gene. These t-scores are the basis of a t test comparing the difference of the 
group means against the null hypothesis that the means of the populations sampled by the experiments 
are equal, taking into account the group variance, and are the input into the algorithm that determines the 
p-values reported. 

Since the logarithms of the data points are taken before the analysis is performed, the fold 
change is determined based on the ratio of the geometric means of the data in the two groups compared. 
For two groups {A} and {B}, the t-score is simply the difference between the mean of {log A} minus 
the mean of {log B}, divided by the root mean square of the variations of the two logged groups, 
weighted by the number of points in each group. Take: 

M(A)=mean {logA} 

V(A) = variance {log A} = standard deviation {log A} squared 

N(A) = number of points in A 
and define similar values for group B. The null hypothesis is given for this test as: 

H(0):M(A)-M(B)=0 
The t-score is given by 

t(A,B) = [M(A) - M(B) ]/sqrt[V(A)/N(A)+V(B)/N(B)] 

The fold change reported is exp(M(A) - M(B)). 

To summarize the t-score calculation, the larger the difference of the log means relative to the 
log variances, the larger the absolute value of the t-score, and the more likely that the groups actually are 
different. The null hypothesis for the t test is that M(A) = M(B), or, equivalent^, that t(A,B) = 0. The 
higher the t-score, the lower the p-value. The p-value reported by the fold change tool is based on 
assuming that the 2 groups {log A} and {log B} are normally distributed, and the weighting factor takes 
into account a possible difference in the group sizes. Summarizing an experimental group's 
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characteristics with its estimated mean and variance is a powerful technique for reducing the complexity 
of analyzing such comparisons. 

This idea can be extended to more than two conditions (or groups, or sample sets) using the 
statistical method of contrast analysis, which uses the results of a one-way analysis of variance 
(ANOVA) on the individual groups. Whereas the simple t test compares two group means, a contrast 
analysis compares the relative levels of a large number of group means to a model specified by the user. 
Many situations that arise in the analysis of expression data are amenable to such analysis, if the method 
is understood property. There are limitations to this method, and care must be taken to understand them 
to ensure that the results are interpretable. This method is particularly useful when comparing the fits of 
two or more models to the data. As in the case with the two group t test, a ranking score (called a t- 
score, or t-like statistic) is generated that allows a comparison of how well a pattern matches the data. 
These patterns are parameterized by a contrast (a series of coefficients for the group means). 

Since the test relies on the null hypothesis that all group means are the same (that is, there is no 
difference in expression among the groups), the only vahd contrasts are those in which the means are 
weighted with coefficients that sum to zero. Ranking the genes for the comparisons in decreasing order 
of t-score should give the same order as ranking the genes in increasing order of p-value. 

The contrast analysis tool uses a more sophisticated algorithm to calculate p-values, one not 
based on the assumption that the measurements are normally distributed within groups. Instead, the p- 
values are calculated by computing a distribution of the maximum t-score over all genes and all patterns. 
First, the expression values for the different genes are randomly reassigned many times, and the entire 
set of t-scores is recomputed. The maximum is found for each iteration, and this distribution of t- values 
is used to estimate the p-value for the maximum t-score reported. The number of mathematically 
independent contrasts that can be tested against is simply the number of groups (G) minus 1 . In the case 
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of the simple t test, G = 2 and only one contrast exists. As G increases, so does the number of 
independent contrasts. 

However, any contrast that is a linear combination of these independent contrasts is valid within 
the theory. Included within the sets of valid contrasts are those which include coefficients equaling 0. 
These cases require special attention, since a weighting of 0 removes that value from the contrast 
calculation in the numerator of the t-score, while including that group's variance in the denominator. 

One simple application of these methods is to rank probe sets by the similarity of their 
expression pattern to the model(s) specified. Consider a comparison between three groups (Groups 1, 2, 
and 3) for three Affymetrix probe sets, as shown in Figure 11, Figure 12, and Figure 13. These show 
three different patterns of expression. In the first case, there is increased expressions in Group 2 and 
Group 3, with the Group 2 and Group 3 expressions about the same. All plots are shown using the log 
scale. 

In the second case, there is a monotonically increasing expression from Group 1 to Group 2 
toGroup3. 

Finally there is a case where Groups 1 and 3 are about the same, while Group 2 is more highly 
expressed than either. 

If one wanted to find the contrast which best describes the situation found in Figure 11, using the 
drawing interface in the contrast analysis tool, one would draw a pattern that showed Group 1 less than 
Groups 2 and 3, but with the latter two at the same level, as shown in Figure 4. The contrast CI that 
results is {-2, 1,1}. The null 
hypothesis is: 

H(0): -2*M(1) + M(2) + M(3) = 0 

Here the means are defined on the logarithm of the raw expression data, as defined above. The t- 
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score is: 

t(l,2,3) = W(C1) * [-2*M(1) + M(2) + M(3)]/sqrt[V(l,2,3)] 

V(l,2,3) is the residual variance from the ANOVA model fit, which depends on the variances of 
ail three groups relative to their respective means, and W is a weighting factor which allows different 
contrasts to be compared to each other. Expressed in terms of these individual group variances, 
V(l,2,3) = [V(1)*(N(1) - 1) -f V(2)*(N(2) - 1) + V(3)*(N(3>1)]/[N(1) + N(2) + N(3) -3] 

No matter what groups are included in a contrast, the residual variance is always obtained from 
the fit to all study groups selected at the start of the contrast analysis session. An issue to remember is 
that the contrast in this case depends on the means and the residual variance of the ANOVA fit. The 
residual variance will be higher, all other things being equal, when the individual group variances are 
higher for all three groups. The higher the Group 2 and Group 3 means relative to Group 1, the higher 
the t-score. If the means are all the same, the t-score is close to 0. If the variances are high for the same 
group means, the t-score will be lower. 

Although the pattern drawn shows Groups 2 and 3 having almost the same expression level, if 
this pattern is used alone without any other patterns to compare it against, there is no guarantee that a 
high t-score corresponds to the case with Groups 2 and 3 sharing approximately the same mean. As long 
as the variances around the Group 2 and Group 3means are small, and the Group 2 and 3means are both 
greater than the Group 1 mean, the conditions are right to get a large positive t-score. If this pattern isn't 
compared to any others, data scoring high using this pattern will include cases where Groups 2 and 3 are 
quite different. 

The solution here is to add two contrasts, comparing Groups 2 and 3 for upward and downward 
changes. Sort the resuh using "Max T-score Contrast Index" as the Primary Sort Column, and "Max T- 
Score" as the Secondary Sort Column (descending). Look for the index corresponding to the pattern of 
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interest, and the values with high maximum t-scores here are those which will strongly match the CI 
pattern. 

If one wanted to find genes that match the pattern in Figure 1 1 or Figure 12, one can use the 
graphical tool, enter in the patterns, and one will receive a warning on the second pattern, stating that the 
weight of the contrast is 0 for Group 2. 

The contrast C2 specified has coefficients {-1,0,1}, which means that the null hypothesis is: 
H(0): -M(l) + M(3) = 0 

This null hypothesis is the same as if one were performing a fold change with Groups 1 and 3 
only. However, the results will be different, because the denominator of the t-score will still include a 
variance contribution from Group 2. The t-score is given by: 

t(l,2,3) = W(C2) [.M(l) + M(3)]/ sqrt[V( 1,2,3)] 

If the Group 2 variance is small, then the t-score will essentially be the same as if Group 2 were 
not included in the comparison. This means that the results of the test would be, in that case, 
independent of the value of the Group 2 mean. If this were the only contrast one were testing against, 
one would get deceptive values indicating a strong match to the increasing pattem even when the Group 
2 mean would be quite different from the average of the Group 1 and Group 3 means, which is implied 
by the pattem one has drawn. 

There are a couple of ways to approach this problem. The first is to use the "Sort by Minimum T- 
score" option of the contrast analysis, and specify increasing contrasts for Group 2 over Group 1 and 
Group 3 over Group 2. By sorting on the minimum t-score, one will get a list where the 2 over 1 and 3 
over 2 contrasts are at least as large as the reported minimum t, so a large positive t will guarantee that 
the expression is increasing across the three groups. 

The other solution is to add contrasts (such as the one in CI) and compare the maximum t-scores. 
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This is done by testing for the case in which the Group 2 mean is different from the average of the 
Group 1 and Group 3 means. If one constructs this as a mathematical equation, one wants: 

M(2) -.5*(M(1) + M(3)) #0 
Or, alternatively, one can test against the null hypothesis that 

H(0):M(2) -.5*(M(1) + M(3)) = 0 

Multiplying through by 2, this corresponds to a contrast with coefficients {-1, 2, -1}. 

If a pattern matches this contrast strongly (that is, the Group 2 mean is greater than the average 
of the Group 1 and Group 3 means), it cannot match the straight line contrast strongly, no matter what is 
going on with the second group. This tests for patterns similar to the one in Figure 3. The other 
confounding case is the contrast with the exact opposite coefficients, which would be {1, -2, 1}, 
implying that the Group 2 mean is less than the average of Groups 1 and 3. Include these additional 
contrasts in the contrast list, and then run the contrast tool comparing the maximum t's. As before, sort 
the result using "Max T-score Contrast Index" as the Primary Sort Column, and "Max T-Score" as the 
Secondary Sort Column (descending). Look at the index of the contrast with maximum t to make sure 
that the pattern being best matched is the one interested in. 

To make the test even more specific, include the contrast to exclude the intermediate case 
specified by contrast CI. Adding more contrasts does not significantly impede computational 
performance if p-values are not being calculated, so one uses as many as needed to isolate the genes of 
interest, and then repeat the calculation with only one pattern to calculate the p-values for those genes. 

A similar line of logic can be applied whenever a zero weight warning is issued; however, with 
larger numbers of groups, one needs to compare the zero weighted group means against all of the 
adjacent levels. Note also that if one has specified more groups in the initial contrast analysis dialog than 
one uses in a comparison, the variances for the group not included will still be incorporated into the 
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analysis, leading to different results for the t-scores than if they had not been included in the first place. 
Contrast Analysis Algorithm 

1. Perform a logarithmic transformation of the data points Eraw(n,g), the raw expression values 
for gene g in sample n. The transformed values are given by: 

5 E(n,g) = log(Eraw(n,g)) for Eraw(n,g) > 1 
= 0 for |Eraw(n,g)| <= 1 
= -log(-Eraw(n,g)) for Eraw(n,g) < 1 

2. Generate the X matrix of group assignments. This consists of N rows by K columns, where N 

|*& is the total number of individual samples, and K is the total number of groups. Li the kth column, the nth 

Mo row contains 1 if the nth sample is in group k, and 0 if not. 
d3 

m 

^ 3. This matrix is the basis of a family of models (one for each gene g): 

I E(g) = Xm(g) + 8(g) 

p where E(g) is a (N X 1) row vector of transformed expression observations for gene g, m(g) is a (1 X K) 
□ column vector of the group means for gene g, and 8(g) is the residual error, assumed to be normally 
□s distributed about 0 with variance a\g). If a value is missing in the row vector E(g) (indicated by a "N" 

or "U" call in the presence call matrix), the calculation will remove it from the matrix and proceed as 

though it were not in the original list. 

4. These models are used to generate the group means estimates e(m(g)). These are solutions to 

the least squares normal equations: 
20 X'Xe(m(g)) = X'E(g) 

Here X' is the transpose of X. Note that the numerical method of solution for this equation is not 

specified here; there are many methods of solving this equation. The current implementation of the 

algorithm uses QR decomposition. 
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5. An estimate of the variance from the fit is obtained by calculating the mean residual sum of 
squares: 

e(a'(g)) = (E(g) - e(in(g)) X)(E(g) - e(in(g)) X)' /(N-(g)-K) 

6. The comparative t-scores are calculated by using the contrast matrix C, a(K X C) matrix of the 
5 C desired contrasts. For each contrast, the cth column consists of a coefficient for the kth group in the 

kth row. The numerators of the c t-scores are given by the rows of the (1 X C) vector N(g): 
N(g) = Ce(in(g)) 

The denominators are given by the square root of the rows of the (1 X C) vector V(g): 
V(g) = |e o\g)) diag(CInverse(X'X) C')|. 

□ 

Do Here diag(X) extracts the diagonal elements of a matrix X. It generates a vector of t's whose cth 

P component is given by: 

I T(g,c)=N(g,c)/sqrt(V(g,c)). 

p Note that unlike the case of the fold change t-scores, the assumption made here is of equal 

U 

Q variances across groups. 

Ul 

CJ5 7. If C > 1, the maximum or minimum t-score is selected out of the tc's for each gene, depending 

on the user input for which comparison is desired. The contrast index c is noted for the contrast that 
satisfies the minimum or maximum criterion. 

8. These maximum or minimum t-scores are then combined across all genes to generate a list 
Tmax(g) of length G indicating which patterns are most/least strongly matched. 
20 9. If the user has requested p-values, these are generated by a procedure whereby the individual 

measurements are assigned with replacement to different samples for 1000 trials. For each 
randomization trial j, calculate the maximum t-score for each g: Tmax(g, j). Take the maximum of all 
these to generate a top ranking t-score TmaxQ). These are pooled together across all the randomization 
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trials and genes to generate a distribution of maximal t-scores Tmaxpooled. The original t-scores 
generated in Step 8 are compared to their rank in this pooled distribution. Divide the number of points in 
the pooled distribution with a greater T-value by the total number of points in the pooled distribution to 
estimate the p-value, that is: 

p(g) = (number Tmaxpooled > t)/G*1000 

The Leave One Out Plot consists of repeating the contrast computation N times. For each of 
these N cases, one of the N samples is left out of the calculation and a ranked Hst 

r(g) = rank of g in Tmax(g) 
of maximum t-scores is generated. If each gene g has a rank r(g,0) with no samples left out and rank 
r(g,n) with sample n left out, then compute for each gene the value: 
d(g,n) = |r(g,n)-r(g,0)| 

One calculates the median value of d over all genes: 

d(n) = median(d(g,n)) 

This value is used as a summary statistic to estimate the effect that leaving one sample out has on 
the results of the analysis (namely, the ranking of the genes according to the contrasts specified). 

In performing a Contrast Analysis, one first selects sample and gene sets for the analysis, 
Then,one defines the contrast pattem(s), A preferred method for accomplishing this is to select either 
highest or lowest for the "T-score among contrasts." Using the maximum T-score to rank genes (that is, 
highest) functions as a logical OR pattern search; that is, genes are ranked high if a large T-score is 
obtained for any of the input pattems. Alternatively, genes can be ranked by the minimum T-score. This 
fiinctions as a logical AND on the input pattems, and is usefiil when the user wants to select for a set of 
genes that match one or more pattems equally well. 

Preferably there are two ways of defining the contrast pattems: specifying a graphical pattern and 
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entering contrast weights. Specifying a graphical pattern option presents a graphical representation of 
the contrast pattern which makes it easier to visualize the contrast pattem(s) being used for the analysis. 
Preferably, the relative direction of the pattern is low, high, or neutral for each of the selected sample 
sets. The pattern represents the change in mean expression value over each checked sample set. Only the 
relative vertical order of the values is significant in the pattern. The pattern is converted to a "contrast," 
which is a list of integer weights, one for each input sample set. 

The contrast weights are positive or negative numbers, one for each input sample set, whose 
values follow the same relative order as the heights of the boxes. The values are scaled and adjusted so 
that the sum of the weights is zero. Zero weights are assigned for sample sets that are not used in the 
pattern. All of the sample sets displayed of the contrast analysis window will be included in the 
analysis. For each sample set a mean and residual will be calculated. The residuals from all sample sets 
will be pooled for use in the t-score calculation, regardless of the pattern and whether or not the sample 
set was selected. This includes samples whose contrast weight is 0. Only the rank order of mean log 
expression levels between the sample sets is considered when converting the pattern to a contrast. For 
example, the following two patterns are considered equivalent; they correspond to the same vector of 
contrast weights, {-1, 2, -1}. Simply put, both patterns will select for genes whose mean log expression 
over Sample Sets 1 and 3 is the same, and is lower than the mean log expression for Sample Set 2. 

The correspondence between patterns and contrast vectors is not always so intuitive. A 
confusing example is the pattern which pattern corresponds to the contrast weight vector {-1, 0, 1 } . It 
will select for genes whose mean log expression level in Sample Set 1 is lower than that in Sample Set 
3. The zero weight for Sample Set 2 means that the mean log expression value over this set is not taken 
into account. The t-score which results will be independent of the mean log value for the second sample 
set, contrary to the appearance of the pattern. For this reason, a warning is preferably issued: 
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In the entering contrast weights option, an advanced interface is provided to allow for entering 
the weights directly. One enters one contrast weight for each sample set. Normalization can also be 
used in the analysis, and the p- value can also be computed. 

When the contrast analysis computation is complete, the results will be displayed in the Results 
5 tab. The Result tab displays the results of the contrast analysis. Preferably the genes from the input 
gene set(s) are sorted in decreasing order of either the maximum or minimum t-score, as specified, in 
Step 2 of the analysis. This view presents the following information: a table of result genes, including: 
the total number of rows displayed in the results, the gene attributes selected by the user, a t-score 

M column for each contrast pattern, the maximum and minimum t-score from the t-score columns, an index 

P 

Qo of the maximum t-score. 

^} 

Preferably, the contrast analysis aspect of the application of the present o9nvention also provides 

j« a Leave One Out Plot. The Leave One Out Plot is a tool for detecting outlier samples. It allows the user 

e 

to identify samples that behave so differently from the other members of their sample sets that they have 

yj 

□ a disproportionate effect on the results of the contrast analysis. These samples can be analyzed further 

yi 

Zts with other tools to determine if there are problems with the sample data quality or if these samples are 
unique in some way. 

Samples that behave very differently from the other members of their sample sets will be 
associated with bars that are taller than most of the other bars in the plot. These samples can be selected 
and "removed." This causes the tool to recompute all the T-scores and ranks based on modified input 
20 sample sets, from which the selected samples have been removed, without actually changing the 
underlying sample sets in the workspace. 

In performing the analysis, the application iterates over the samples in the input sample sets. For 
each sample, the application removes the sample from its sample set, recomputes the t-scores for all 
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contrasts for the N genes, re-ranks the genes by maximum or minimum t-score, subtracts each gene's 
original ranking from its new rank, and computes the absolute value of the difference. The median of 
these absolute rank differences for the N genes is then computed. Finally the median is reported for each 
sample in the Leave One Out plot. 
5 Preferably there are a variety of menu options that are available for use with the Contrast 

Analysis, including: a File, New tab which opens a new Contrast Analysis window; a File, Open tab 
which opens the Select Contrast Analysis window from which a previously saved contrast analysis can 
be opened; a File, Save Contrast Analysis tab which opens the Save Contrast Analysis As window 
I«A where the contrast can be named and saved; a File, Save Gene Set tab which opens the Save Gene Set 

9 

Clo As window in which the resulting gene set from the Contrast Analysis can be saved; a File, Save 

y? 

J 2 Selected Genes tab which opens the Save Gene Set As window in which selected gene fragments can be 

^« saved as a unique gene set; a File, Export tab which provides options for exporting the results; a File, 

p Invoke tab which provides options for accessing third-party applications in which to view the results; a 

yj 

p File, Print tab which opens the Page Setup window for setting up the page layout and printing the 

U1 

£35 results; and a File, Close tab which closes the Contrast Analysis window. 

W 

Preferably the Contrast Analysis menu fiirther includes a View, Compute Form tab which opens 
the Compute tab; a View, Results tab which opens the Results tab; a View, Show Details Panel tab 
which toggles to display the details panel in the Results tab; a View, Select Display Attributes tab which 
opens the Select Display Attributes window where columns to display gene attributes and data values 
20 can be selected; a View, Gene Set Mask Add/Remove Mask tab which opens the Add/Remove Gene Set 
Mask window in which a masking gene set can be applied to or removed from the input gene set; a 
View, Remove Selected Genes tab which removes the selected genes from the currently displayed 
results; a View, Remove Unselected Genes tab which removes the unselected genes from the results; a 
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View, Reset to Original Gene Set(s) tab which resets the results to their original state; a View, Sort By 
tab which sorts the resuhs; and a Plot Options tab which opens the Plot Option window. 

Additional preferred aspects of the present invention is the fragment index and the gene query 
attribute tree. Aspects of these components of the present invention include cross-species homology in 
the gene index; co-clustered sequences and searching by GenBank Accession; BLAST Hits and 
Warnings; gene ontologies; and gene query attribute tree. 

Cross-species homology is represented in two principal ways in the gene index: a relationship 
between Known Genes that uses curated lists of homologous genes from the Mouse Genome Database 
(MGD) and a relationship between Sequence Clusters that uses shared similarity to protein sequences. 

The lists from MGD are of homologous pairs of mouse and human genes, and of mouse and rat 
genes. In the Gene Index, "human -> rat" homologies are also included by transitive extension of the 
"rat ->mouse" and "mouse -> human" relationships. Gene fragments (i.e., probe sets) corresponding to 
cross-species homologies are accessible through the Cross Sp. Homologous Fragments query option, 
which is under Homologies. There can be extended to other species by exporting the data and then re- 
importing the list as a gene set in the context of the other species. 

These gene-level homologies are accessible both for query and display through the Known Gene 
query option, and are also displayed in the Attributes details panel for a given individual fragment. 

If two sequence clusters share homology to the same protein sequence, as determined by the 
PROTSIM data from UniGene, each points to the other as a Homologous Cluster. Homologous clusters 
may be of the same species or of different species. 

Frequently, users of the gene index have a GenBank accession of a sequence, and would like to 
find fragments (probe sets) on the chips that correspond to this sequence. An appropriate way to do this 
is by searching co-clustered sequences, under AFFX Gene Fragment. For a given Affymetrix gene 
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fragment, Co-clustered Sequences contain all sequences in UniGene which are in the same sequence 
cluster (or clusters) as the fragment. This provides very good coverage of ESTs. If an exact accession is 
known (or a list of accessions is available using the Import by Attribute method, using "matches" is 
considerably faster. 

5 Many Affymetrix Gene Fragments may correspond to the same Sequence Cluster. To find 

Affymetrix Gene Fragments that are in the same Sequence Cluster as a given fragment, search using Co- 
clustered AFFX fragments (under Related Other AFFX Fragments). 

Co-clustered AFFX fragments may include fragments in other chipsets in addition to the chipset 
one is starting with. For example, the co-clustered fragments of a given Affymetrix Gene Fragment in 
^Q the Hu42K chip set may include fragments in both the Hu42K chip set and the HG U95 chip set, 
^ The data in BLAST Hits and Warnings comes from two sources. One is a list of problematic 

^« fragments provided by Affymetrix. The other is a BLAST of the sif sequence ("Tiled Region Sequence" 

)} 

□ in the fragment detail view) against NCBFs Refseq database of full-length transcripts. The oligomer 

yj 

□ probes on the chip are derived from a subset of the sif sequences. BLAST hits which are above a 

U1 

Gi5 sensitivity threshold (97% identity over greater than 80% of the sif sequence length) fall into three 
categories: if the match of the sif sequence is to the antisense strand, the Warning Message is set to 
"Matches wrong strand;" if the match is to the sense strand, the minimum, maximum, and mean 
distances of the match to the 3-prime end of the transcript are calculated and entered in the Min. 
Distance, Mean Distance, and Max. Distance fields; if the mean distance to the 3-prime end is greater 
20 than 1000 nucleotides, the Warning Message is set to "Probes far from Sprime end," 

In all cases, the GenBank accession of the Refseq sequence is entered in the Ref Seq ID field, 
and the symbol of the corresponding gene appears in the Gene field. The Fragment Warning attribute of 
a Affymetrix Gene Fragment is derived from the data in BLAST Hits and Warnings. The default value 
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of Fragment Warning is "No." It is set to "Yes" if: the fragment is on Affymetrix' list of problematic 
fragments OR there are BLAST hits with warnings but none without warnings 

The Gene Ontology Consortium (http://genome-www.stanford.edu/GO/ ) is a public project 
dedicated to providing a dynamic controlled vocabulary that can be applied to all eukaryotes even as 
knowledge of gene and protein roles in cells is accumulating and changing. An ontology of biological 
terminology provides a model of biological concepts that can be used to form a semantic framework for 
many data storage, retrieval, and analysis tasks. Such a semantic framework could be used to facilitate 
seamless integration of various heterogeneous bioinformatics data, and allows uniform querying across 
them. 

Gene Ontology (GO) terms are defined by three different principles: molecular fiinction: 
describes the tasks performed by individual gene products; examples are transcription factor and DNA 
helicase; biological process: describes broad biological goals and the process is accomphshed by 
ordered assemblies of molecular fimctions; example is purine metabolism process; and molecular 
component: encompasses sub-cellular structures, locations, and macromolecular complexes; examples 
include nucleus, telomere, and origin recognition complex. 

Various preferred embodiments of the invention have been described in fulfilknent of the 
various objects of the invention. It should be recognized that these embodiments are merely 
illustrative of the principles of the invention. Numerous modifications and adaptations thereof 
will be readily apparent to those skilled in the art without departing from the spirit and scope of 
the present invention. 
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